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ABSTRACT 

This  dissertation  investigates  the  problem  of  automatic 
transcription  of  the  hand-keyed  Morse  signal.  A unified 
model  for  this  signal  process  transmitted  over  a noisy 
channel  is  shown  to  be  a system  in  which  the  state  of  the 
Morse  process  evolves  as  a memory-conditioned  probabilistic 
mapping  of  a conditional  Markov  process,  with  the  state  of 
this  process  playing  the  role  of  a parameter  vector  of  the 
channel  model.  The  decoding  problem  is  then  posed  as  finding 
an  optimal  estimate  of  the  state  of  the  Morse  process,  given 
a sequence  of  measurements  of  the  detected  signal.  The 
Bayesian  solution  to  this  nonlinear  estimation  problem  is 
obtained  explicitly  for  the  parameter-conditional  linear- 
gaussian  channel,  and  the  resulting  optimal  decoder  is  hown 
to  consist  of  a denumerable  but  exponentially  expanding  set 
of  linear  Kalman  filters  operating  on  a dynamically  evolving 
trellis.  Decoder  performance  is  obtained  by  computer  simula- 
tion, for  the  case  of  random  letter  message  texts.  For 
nonrandom  texts,  further  research  is  indicated  to  specify 
linguistic  and  format-dependent  models  consistent  with  the 
model  structure  developed  herein. 
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I . INTRODUCTION 


The  problem  of  automatically  transcribing  the  hand-keyed 
manual  morse  (HKM)  signal  with  an  acceptable  error  rate, 
without  exact  knowledge  of  the  sender's  keying  character- 
istics and  transmitted  signal  parameters,  has,  in  general, 
remained  unsolved.  The  easier  companion  problem  of  auto- 
matically transcribing  a Morse  signal  sent  by  a keyboard 
(RAM) , and  whose  transmitted  frequency  is  known,  has  largely 
been  solved,  and  a number  of  Morse  decoders  are  commercially 
available  for  this  task.  These  decoders  also  can  be  used 
on  the  HKM  signal,  but  with  considerable  loss  in  performance 
except  in  cases  of  very  good  keying  quality. 

The  difficulty  of  automatically  transcribing  the  HKM 
signal  (problems  in  frequency  acquisition  and  detection 
aside)  is  often  not  recognized  by  the  uninitiated.  This 
difficulty  is  analogous  to  that  of  designing  an  automatic 
speech  recognition  device.  VJhile  the  analogy  cannot  be 
taken  too  far,  certain  parallels  are  evident.  The  HKM 
signal,  being  a human-generated  process,  has  all  the  char- 
acteristics of  individuality  associated  with  such  a process. 
No  two  senders  of  Morse  send  in  exactly  the  same  way,  just 
as  no  two  speakers  speak  in  exactly  the  sa.me  way.  Yet  a 
trained  Morse  operator  can  understand  what  is  being  sent, 
just  as  a person  who  understands  the  language  of  a speaker 
can  understand  (almost)  anyone  who  speaks  that  language, 
whatever  the  individual  characteristics  of  his  speech.  A 


Morse  transcription  machine  for  HKM  which  bases  its  deci- 
sions solely  on  the  local  Morse  symbols  (dot,  dash,  element 
space,  character  space,  word  space,  pause)  can,  with  some 
imagination,  be  likened  to  a situation  in  which  a person 
who  does  not  know  English  attempts  to  translate  a spoken 
English  phrase  by  isolating  the  syllables  of  the  words. 
Clearly  the  Morse  transcription  task  is  not  quite  so  diffi- 
cult as  this  analogy  since  there  are  only  six  "syllables" 
in  Morse;  yet  the  analogy  is  illustrative  of  the  difficulty 
of  transcribing  the  HKM  process. 

On  the  other  hand,  the  KAM  signal  can  be  likened  to  a 
teletype  signal  with  a well-defined  structure.  Thus  it  is 
sufficient  to  decode  such  a signal  on  the  basis  of  the  baud 
structure,  since  there  is  a one-to-one  mapping  from  the  code 
words  to  the  text.  This  non-singular  mapping  accounts  for 
the  relative  ease  of  decoding  a demodulated  KAM  signal. 

The  above  analogy  has  tacitly  assvimed  that  the  Morse 
waveform  was  perfectly  demodulated.  In  the  real  world  of 
imperfect  demodulation,  it  is  clear  than  an  HKM  transcription 
machine  which  uses  only  local  information,  can  provide  no 
error-correction  capability  to  correct  incorrectly  demodu- 
lated Morse  symbols.  Thus  as  a result  of  a single  incorrect 
demodulation  decision,  an  entire  letter  (two  letters  if  the 
symbol  was  a character  space)  is  transcribed  incorrectly. 
Demodulation,  therefore,  must  be  considered  as  an  integral 
part  of  the  HKM  processor,  and  this  processor  must  have  some 
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knowledge  of  the  Morse  "language”  in  order  to  provide  error- 
correction  capability. 

This  paper  reports  the  results  of  an  investigation  into 
the  problem  of  automatically  transcribing  the  HKM  process. 

The  problem  is  attacked  from  the  point-of-view  of  optimal 
estimation  and  modern  information  theory.  Theoretical  results 
are  derived  which  can  be  directly  applied  to  the  design  of  an 
optimal  HKM  transcriber.  It  is  shown  that  such  an  optimal 
transcriber  is  unrealizable  in  the  practical  sense,  but  that 
a suboptimal  transcriber  which  can  be  made  arbitrarily  close 
to  optimal  is  realizable.  Lower  bounds  on  the  theoretical 
error-rate  performance  of  an  ideal  transcriber  are  obtained 
as  a function  of  signal-to-noise  ratio,  keying  characteristics, 
and  HK14  model  complexity.  The  performance  of  the  suboptimal 
transcriber  is  obtained  by  computer  simulation  and  compared 
to  the  theoretical  results  for  the  optimal  transcriber. 

Finally,  the  suboptimal  transcriber  is  tested  against  a limited 
set  of  field  data  in  order  to  validate  the  simulations. 

The  report  is  organized  into  two  parts:  theoretical  and 
application.  In  the  theoretical  section,  a unified  model 
structure  for  the  HKM  process  is  deriv’^ed  which  may  account  for 
code  symbol  dependencies,  variation  in  data  rate,  operator 
sending  anomalies,  source  letter  context,  message  format,  and 
linguistic  dependencies.  A channel  model  is  constructed  to 
account  for  transmitter,  propagation,  and  receiver  effects. 

The  resulting  modeled  system  is  shown  to  be  a system  in  which 
the  state  of  the  HKM  process  evolves  as  a memory-conditioned 
probabilistic  napping  of  a conditional  Markov  process,  with 
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the  state  of  this  process  playing  the  role  of  a parameter 
vector  of  the  channel  and  measurement  models.  The  joint 
demodulation,  decoding,  and  translation  problem  is  then 
posed  as  finding  an  optimal  estimate  of  the  discrete  state 
of  the  HKM  signal  process,  given  a sequence  of  noisy  measure- 
ments of  the  detected  signal.  The  Bayesian  solution  to  this 
nonlinear  estimation  problem  is  obtained  explicitly  for  the 
case  of  parameter-conditional  linear-gaussian  channel  and 
measurement  models , and  the  resulting  optimal  Morse 
transcription  machine  is  shovm  to  consist  of  a denximerable 


but  exponentially  expanding  set  of  linear  Kalman  filters 
operating  on  a trellis  defined  by  the  discrete  state  values 
of  the  parameter  vector.  Because  of  the  exponential  growth, 
the  optimal  estimator  is  unrealizable,  and  a realizable 
suboptimal  solution  which  adaptively  restricts  the  growth 
of  the  trellis  is  obtained. 

The  application  section  shows  how  a specific  model  of  the 
HKM  process  results  from  the  general  model  constructed  in  the 
theoretical  section.  It  is  shown  in  principle  how  the 
generality  of  the  model  readily  provides  for  any  level  of 
complexity  in  modeling  an  actual  Morse  message,  i.e.  from  a 
very  simple  model  of  local  Morse  symbols  up  to  and  including 


a complex  model  of  syntactic  and  semantic  rules  for  the  Morse 


"language."  It  is  shown  theoretically  how  context  may  be  used 
to  provide  error-correction  capability  and  reduce  the  lower- 
bound  on  output  letter-error  rate.  Simulation  results  are 
obtained  which  confirm  the  expected  improved  performance  for 
increasingly  complex  modeling  of  the  Morse  message. 
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II.  PROBLEM  DESCRIPTION 


The  statement  of  the  problem  is  actually  very  simple; 
Obtain  a processor  which  will  transcribe  hand-keyed  manual 
Morse  as  well  as  a human  operator.  The  simplicity  of  the 
statement,  however,  belies  the  complexity  of  describing  a 
"hand-keyed  manual  Morse"  signal  and  the  difficulty  of 
quantifying  the  phrase  "as  well  as  a human  operator." 

A.  THE  HAND-KEYED  MANUAL  MORSE  (HKM)  SIGNAL  PROCESS 

As  used  throughout  this  report,  the  term  HKM  signal 
refers  to  International  Morse  Code  and  its  derivatives  sent 
manually  by  key,  mechanical  bug,  or  electronic  bug.  The 
baseband  HKM  process  is  the  output  voltage  level  of  the  keyer 
and  is  represented  by  the  logic  levels  0 and  1,  corresponding 
to  the  states  "key  up"  and  "key  down."  The  six  symbols  of 
the  code  are:  dot,  dash,  element-space , character-space , 
word- space,  and  pause.  The  term  element  (or  baud)  refers 
to  the  standard  time  unit  of  the  code;  its  actual  duration 
in  seconds  will  of  course  vary  with  sending  speed.  Standard 
Morse  code  consists  of  the  symbol  durations  shown  in  Table  I. 

The  standard  word  (including  word-space)  in  Morse  commun- 
ication is  50  elements  in  length.  Thus  the  standard  element 
duration  in  seconds  for  a given  sending  speed  is  6/5  times 
the  reciprocal  of  the  speed  in  words-per-minute.  The 
instantaneous  data  rate  for  an  HKM  signal  is  defined  to  be 
6/5  times  the  reciprocal  of  the  duration  of  the  symbol  (in 
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TABLE  I 


Standard  Morse  Symbols 


Name  Symbol 


Dot 

Dash 

Element-space 
Character-space 
Word- space  W 

Pause  P 


Duration  (in  elements) 

1 

3 

1 

3 

7 

14 


seconds)  divided  by  the  standard  duration  in  elements; 
e.g.,  the  instantaneous  data  rate  for  a dash  of  duration 
60  msec  is  (6/5) / (1/. 020)  = 60  wpm. 

An  HKM  signal  differs  from  the  standard  Morse  signal 
in  that  the  instantaneous  data  rate  is  a random  variable, 
resulting  in  symbol  durations  which  are  random.  The  element 
duration  is  defined  to  be  the  mean  value  of  the  dot  duration; 
this  mean  value  is  also  a random  variable.  The  HKM  signal 
may  exhibit  a large  variation  in  both  element  duration  and 
instantaneous  data  rate.  The  modeling  of  these  random  variables 
is  discussed  in  section  VI. A.  The  distributions  of  element 
duration  and  instantaneous  data  rate  are  unique  to  a particu- 
lar sending  operator,  and  in  most  cases  depend  on  the  type 
of  traffic  being  sent,  and  on  the  intended  recipient  of  the 
signal  as  well. 
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B.  THE  HKM  SIGNAL  CHANNEL 


pp««pnw  IK .1  Jig,. 

. x-: 


The  HKM  signal  process  is  usually  transmitted  at  HF  by 
a transmitter  whose  final  sunplifier  is  on-off  keyed  (OOK) 
by  the  keyer,  although  in  some  cases,  the  oscillator  itself 
is  on-off  keyed.  Because  of  the  effect  of  transients  in  the 
transmitter,  the  signal  is  usually  chirped  to  some  extent, 
the  magnitude  of  the  chirp  being  indicative  of  the  quality 
of  the  transmitter  design  and  state  of  maintenance.  For 
well-designed,  properly  maintained  transmitters,  the  chirp 
is  on  the  order  of  tens  of  Herts.  Poorly  designed  or  improp- 
erly maintained  transmitters  may  exhibit  as  much  as  300Hz 
chirp,  as  well  as  random  drift  of  the  nominal  carrier  fre- 
quency. Thus  in  most  cases,  signal  detection  must  be  accom- 
plished by  using  an  envelope  detector  since  the  phase  of 
the  signal  is  not  known. 

In  addition  to  the  signal  uncertainties  caused  by  the 
transmitter  itself,  the  signal  is  also  corrupted  by  both 
additive  and  multiplicative  noise  in  the  form  of  atmospherics, 
interference,  and  fading,  which  at  HF  is  nonstationary.  Thus 
demodulation  of  the  OOK  Signal  must  be  accomplished  in  the 
face  of  frequency,  phase,  and  amplitude  uncertainty,  along 
with  incomplete  knowledge  of  the  noise  statistics. 


C . OPERATOR  PERFORMANCE 

The  ultimate  goal  of  the  Morse  transcriber  is  to  provide 
output  copy  with  an  error  rate  approaching  that  which  a 
typical  human  operator  provides.  The  human  operator  rapidly 
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adapts  to  changing  signal  and  channel  parameters  and  can 
provide  reliable  copy  of  a highly  variable  HKM  signal  in  the 
presence  of  numerous  other  Morse  and  non-Morse  signals.  The 
operator  is  obviously  aided  by  an  understanding  of  the  context 
of  the  message,  the  format,  and  the  Morse  "language." 

The  available  data  on  operator  performance  is  summarized 
in  Figures  1 and  2.  Figure  1 is  a plot  of  error  rate  vs. 

SNR  for  an  actual  communications  link  in  the  LF  band  reported 
by  Watt  et.  al.  [1] , while  Figure  2 shows  the  performance 
obtained  in  a laboratory  experiment  [2].  Both  tests  were 
conducted  using  random  five- letter  code  groups  as  the  test 
message.  Table  II,  from  Lane  [3] , shows  the  number  of  dB 
which  must  be  added  or  subtracted  from  the  abscissa  of  the 
performance  curve  to  obtain  the  performance  for  different 
speeds  of  transmission.  Clearly  the  laboratory  tests  show 
a better  performance  capability  for  the  human  operator  than 
that  obtained  for  the  actual  communication  link,  with  a 
difference  of  about  2-3  dB  for  equal  error  rates.  Such  an 
observation  indicates  that  one  must  design  the  automated 
transcriber  using  the  laboratory  performance  measurements 
in  order  to  obtain  the  required  performance  under  field 
conditions  for  the  same  SNR. 

The  error  rates  discussed  above  were  obtained  using  a 
text  consisting  of  independent  letters  (5-letter  code  groups) . 
For  a text  which  has  more  structure  than  random  letters, 
whether  through  linguistic  content,  known  message  format. 
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TABLE  II  j 

OPERATOR  PERFORMANCE  ADJUSTMENT  FACTOR  ’ 

FOR  SENDING  SPEEDS  i 

(FROM  LANE  [3])  ; 


RATE 

FACTOR 

(wpm) 

(dB) 

10 

-5.0 

12 

-3.6 

14 

-2.3 

15 

-1.8 

16 

-1.4 

18 

-0.6 

20 

0 

25 

1.6 

30 

2.6 

or  increased  semantic  content,  the  human  operator  will  take 
advantage  of  the  structure  to  effectively  reduce  his  average 
error  rate.  His  error  rate,  however,  for  those  portions  of 
a message  which  exhibit  uncertainty  equivalent  to  independent 
letters,  will  remain  at  that  for  independent  letters.  Thus 
although  his  error  rate  for  those  portions  of  a message 
which  have  a high  information  content  will  not  decrease, 
the  transcribed  message  will  be  much  more  "readable,"  and 
the  more  costly  errors  will  be  much  easier  to  locate  in  his 
output  copy.  As  an  example  of  "readability",  consider  the 
two  messages  shown  below,  each  with  a 10%  error  rate,  including 
spacing  errors.  The  first  message  is  of  low  information 
content  and  is  readable,  although  with  some  difficulty;  the 
second  is  a message  with  higher  information  content.  (These 
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two  messages  were  generated  by  using  a random  number  generator 
to  obtain  the  errors,  which  may  not  correspond  to  typical 
morse  substituions . ) 


Message  1: 

THIS  IS  AN  RX  A9P  LE  OF  EN  G LI  SH  TE  XT 
WITH  AN  ERROR  RATE  OF  10  PERCENK.  THC 
ERRORS  INCLUDE  SPA  CING  BETWEEN  LE  TTERS 
AS  WELL  AS  THE  WPlD  SPACE.  MS  CAN3  E 
SEEN,  THIS  TEXT  IS  ON  TH  E THRESHOLDO  F 
ACC  EPTABILRTY  AN  D REQUIRA  2 SlAE 
DIFW8C  U LTX  TO  R EAD. 


Message  2:  j 

] 

BM  GEZRGE  P BURDELL  TO  JOXN  BUUYEL  | 

L123  EASW  S T BEW  YORK  BT  j 

PSE  C ALL  NAMP  HO  NE  NO  555  1233  AND  | 

TELL  SIM  WILL  NOW  DRR  IVE  KENNE  DY  | 

AVTAN  17  38  12  JU  LFLT  NO  63  j 

i 

WILL  DEPANT  FOX  WAMH  AT  231  9 12  JUL. 

The  obvious  point  of  this  exercise  is  that  average  letter 
error  rate  alone  is  not  a definitive  measure  by  which  the 
efficiency  of  a transcriber  (either  human  or  machine)  can 
be  judged,  except  for  messages  consisting  of  random  letters. 

Secondly,  it  is  clear  that  an  automatic  transcriber  which 
does  not  use  the  message  context  and  structure  (linguistics, 
semantics,  format)  to  decode  the  received  message  will  not 
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be  capable  of  producing  a transcript  as  readable  as  the 
human  operator  except  for  random  letter  texts. 
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III.  LO^’JER  BOUNDS  ON  ERROR  RATE 

In  this  section,  information  theoretic  concepts  are 
applied  to  the  problem  of  decoding  and  translation  of  the 
Morse  signal.  Lower  bounds  on  the  performance  of  a trans- 
cription machine  are  obtained  as  a function  of  signal-to- 
noise  ratio,  keying  quality,  and  decoder  complexity.  A 
channel  model  appropriate  for  studying  the  performance  in 
this  context  is  derived  and  its  capacity  determined.  Source 
code  models  for  the  Morse  code  are  also  obtained,  and  together 
with  the  channel  model,  are  used  to  derive  a lower  bound  on 
decoded  letter  error  rate.  Although  the  average  letter 
error  rate,  as  argued  in  the  previous  section,  is  not  a 
sufficient  criterion  for  measuring  the  utility  of  a trans- 
cription machine  in  specific  cases,  it  nevertheless  provides 
a great  deal  of  insight  into  the  problem  of  determining  how 
complex  a decoder  must  be  in  order  to  approach  the  perfor- 
mance of  a human  operator.  In  order  to  obtain  some  intuitive 
appreciation  of  the  Morse  code  as  a source  code,  estimates 
of  the  entropy  of  a Morse-coded  source  are  first  determined 
under  various  assumptions  about  the  source  and  the  code. 

A.  ESTIMATION  OF  MORSE-CODE  ENTROPY 

The  source  entropy  for  a symbol-by-symbol  decoder  is 
obtained  by  considering  the  source  to  be  an  ensemble  of 
Morse  symbols  each  sent  independently  with  probability  equal 
to  the  expected  relative  frequency  of  occurrence  of  that 


symbol.  A decoder  which  is  designed  according  to  a model 
of  the  source  as  a Markov  chain  results  in  a source  entropy 
calculated  on  the  basis  of  that  same  Markov  model.  Thus 
various  levels  of  model  complexity  result  in  corresponding 
levels  of  source  entropy,  as  seen  by  the  decoder.  For 
independent  symbol  sequences  the  source  entropy  for  an 
alphabet  of  size  M is  given  by  [4] : 


H = - E p(i)log  p(i) 

i=l 


p(i)  = relative  frequency  of  occurrence  of  symbol  i. 


For  Markov  sources  the  entropy  is  given  by  [4,p.68] 


H(u)  - - Z q(i)H(u|s=i) 

i=l 


where  q(i)  = limiting  probability  of  the  state  s = ij 


H(u/s=i)  = 


Pj  (V  - Pr(Uj  - 


i.e.  the  probability  that  source  letter  a^^  is  produced  when 
the  Markov  process  is  in  state  j at  time  1. 
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1.  Independent  Symbols 

Consider  first  the  case  of  a source  modeled  by 
independent  occurrences  of  the  Morse  symbols.  In  this 
case  the  entropy  is 

^ ~ ”^dot^°^^dot  ^dash^°^^dash  ^esp^°^^esp  ^csp^°^^csp  ' 
The  relative  frequencies  of  the  symbols  in  random  Morse 


^dot  - *26/  Pdash  " *24,  Pggp  - .36,  - .14; 


and  the  entropy  is: 


H = .261og(.26)  - .241og(.24)  - .361og(.36)  - .141og(.14) 


= 1.927  bits/Morse  symbol 


Since  there  are  1.76  bauds  per  Morse  symbol,  on 

the  average  , the  entropy  in  bits  per  channel  digit  is 

H = 1.927/1.76  = 1.09  bits. 

2.  First-Order  Markov  Process  on  a Symbol  Basis 

The  independent  symbol  model  of  Morse  is  actually 
only  of  passing  interest  since  even  the  crudest  of  Morse 
models  recognizes  the  fact  that  in  Morse  code  a mark  symbol 
(dot  or  dash)  must  always  be  followed  by  a space  symbol 
(esp  or  csp) , and  vice  versa. 
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A first-order  Markov  model  has  the  following 
approximate  transistion  matrix  and  limiting  probabilities: 


dot 

o O 
ft 

dash 

0 

esp 

.7 

csp 

.3 

q(i) 

.26 

dash 

0 

0 

.7 

.3 

.24 

esp 

.55 

.45 

0 

0 

.36 

csp 

.5 

.5 

0 

0 

.14 

Using  the  formulas  given  above  for  finding  the  entropy  of  a 
Markov  source. 


H(uls=l)  = -.71og(.7)  - .31og(.3)  * .8813 
H(uls=2)  = -.71og(.7)-  .31og(.3)  = .8813 
H(ujs=3)  = .551og(.55)  - .451og(.45)  = .9929 
H(u  |s=4)  = -.51og(.5)  - .51og(.5)  = 1.0 

H(u)  = (.26)  (.8813)  + (.24)  (.8813)  + (.36)  (.9929)  + (.14)  (1.0) 
= .938  bits/Morse  symbol 
= .533  bits/channel  digit 

3 . Second-Order  Markov  Process  On  A Symbol  Basis 

A second-order  Markov  process  of  the  Morse  Code  has 
the  approximate  transition  Matrix  and  limiting  state 
probabilities  as  follows: 


I 

i 


t|.  ' 


• ^ 

• a. 

~'\j 

A • 

q(i) 

• A 

“o 

0 

0 

0 

.55 

0 

.45 

o” 

.187 

• r\j 

0 

0 

0 

0 

0 

.5 

0 

.5 

.073 

0 

0 

0 

0 

.55 

0 

.45 

0 

.173 

0 

0 

0 

0 

0 

.5 

0 

.5 

.067 

.7 

.3 

0 

0 

0 

0 

0 

0 

.187 

Of. 

.97 

.03 

0 

0 

0 

0 

0 

0 

.073 

- 

0 

0 

.6 

.4 

0 

0 

0 

0 

.173 

'\j~ 

0 

0 

.97 

.03 

0 

0 

0 

0 

.067 

Again,  using  the  formulas  for  the  entropy  of  a Markov  source, 
the  entropy  of  the  source  for  this  model  is  found  to  be 


H = .858  bits/Morse  symbol 
= .488  bits/channel  digit 


4.  Independent  Letters 

The  entropy  of  a source  which  produces  equally 
likely  independent  letters  from  an  alphabet  of  size  36 
(26  alphabet  letters,  10  numerals)  is 


H = -log  (.02776)  = 5.17  bits/ltr 

The  average  number  of  Morse  symbols  per  letter  is  7.27, 
resulting  in  an  average  entropy  for  the  Morse  symbols; 

H = 5.17/7.27  = .711  bits/Morse  symbol 

clV^ 

= .404  bits/channel  digit 
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5.  English  Text  [5] 

For  a model  of  an  English  text  source,  producing 
equally  independent  letters,  the  entropy  is  4.76  bits/letter. 
Using  the  proper  relative  frequencies  for  the  occurrence 
of  each  letter,  the  entropy  is  reduced  to  4.03.  A first- 
order  model  of  English  has  entropy  3.32,  and  a second  order 
model  reduces  the  entropy  to  3.1.  A model  which  produces 
equally  likely  words  of  text  has  an  entropy  of  2.14.  Thus 
if  a decoder  which  properly  uses  context,  linguistics,  and 
message  structure  can  be  designed,  then  the  entropy  of  the 
Morse  symbol  for  English  text  can  be  as  low  as  2.14/7.27 

= .294  bits/symbol 
= .167  bits/channel  digit 

In  summary,  then,  it  can  be  seen  that  there  is 
considerable  merit  in  using  for  design  purposes  a model  of 
the  encoded  source  based  on  independent  or  Markov  letters, 
rather  than  a model  based  on  a probabilistic  description 
of  a sequence  of  Morse  symbols.  (The  various  entropies 
are  tabulated  in  Table  III.)  Given  an  optimal  demodulator, 
a decoder  which  fully  exploits  the  letter  structure  of  the 
encoded  source,  then,  can  be  expected  to  perform  as  well  as 
the  human  operator  for  a source  of  independent  letters. 

As  discussed  previously,  however,  any  Morse  message  of 
significant  interest  does  not  consist  of  independent  letters, 
and  the  human  operator  easily  exploits  the  decrease  in 
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TABLE  III 

ENTROPY  OF  MORSE  CODE  SYMBOLS 
AND  CHANNEL  BITS 


MODEL 

MORSE  SYMBOL 

CHANNEL  BIT 

INDEP  SYMBOLS 

1.927 

1.09 

FIRST-ORDER 
MARKOV  SYMBOLS 

.938 

.533 

1 

SECOND-ORDER 
MARKOV  SYMBOLS 

.858 

.488 

INDEP  SOURCE 

LTRS 

.711 

.404 

ENGLISH  TEXT 
EQUI-PROB  LTRS 

.655 

.372 

ENGLISH  TEXT 
FIRST-ORDER 
MARKOV  LTRS 

.457 

.260 

\ ; 

ENGLISH  TEXT 
EQUI-PROB 

WORDS 

.294 

.167 

[Li 

source  entropy  by  knowing  the  context, 

linguistics , 

i; 

semantics , and  format 

of  the  message. 

Conversely,  any 

decoder  which  does  not 

exploit  this  decrease 

in  source 

1' 

entropy  can  never  match  the  capability 

of  the 

human 

operator,  although  it  may  perform  well  enough  in  some 
cases  to  be  of  value. 
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B.  IDEALIZED  HKIi  CHANNEL  MODEL 

Since  the  objective  here  is  to  obtain  lower  bounds  on 
error  rate,  and  not  an  estimate  of  actual  performance,  it 
is  appropriate  to  consider  an  idealization  of  the  HKM 
process,  the  detection  process,  and  optimum  demodulation 
in  the  presence  of  white  gaussian  noise.  As  such,  the  output 
i of  the  detector  would  be  input  to  a matched  filter  whose 

. integration  time  is  equal  to  the  element  duration  of  the 

Morse  code  being  received.  Exact  knowledge  of  the  baud 
' length  is  assumed  in  order  that  the  matched  filter  cein 

remain  in  synchronism  with  the  incoming  signal.  Obviously 
no  decoder  for  HKM  can  ever  have  such  information  with 
certainty,  thus  this  idealization  represents  the  best 
possible  demodulator  which  can  never  be  achieved  in  practice. 
Secondly,  the  error  crossover  probabilities  (dot  vs.  dash; 
element-space  vs.  character  space)  are  idealized  to  be 
^ discrete  probabilities  rather  than  considering  duration 

densities  for  these  symbols;  the  word-space  is  included 
as  a source  letter  and  the  pause  symbol  is  ignored  for  this 
analysis.  Under  these  simplifying  assumptions,  the 
channel  can  be  modeled  as  a discrete  symmetric  channel , 
as  shown  in  Figure  3. 


Figure  3.  Idealized  HKM  Channel  Model 

In  this  model,  the  crossover  probability  6 is  related 
to  the  Morse  symbol  crossover  probability  by  defining  5 to 
be  the  probability  which  yields  the  same  average  letter 
error  rate  as  the  symbol  crossover  probability  on  the 
basis  of  an  average  encoded  letter.  Since  the  average 
letter  of  Morse  code  consists  of  7 symbols  and  12  channel 
bits,  6 is  defined  by  the  relationship 

^ (1  - 6)12  , 
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where  E is  the  average  sending  letter  error  rate  and  P 

S 6S 

is  the  corresponding  symbol  error  crossover  probability. 
It  will  be  convenient  to  make  the  following  definitions 
on  the  keying  quality  of  a HKM  signal: 


GOOD: 

E = 
s 

.01 

(^es  = 

.00143, 

5 = 

.000837) 

FAIR: 

^s  = 

.1 

<^s  = 

.0149, 

6 = 

.00874  ) 

POOR: 

^s  = 

.25 

^^es  = 

.0403, 

6 = 

.0237) 

that  is,  a good  sending  operator  sends  the  Morse  symbols 
such  that  the  resulting  code  stream  consists  of  encoded 
letters  in  which  1%  contain  at  least  one  incorrect  Morse 
symbol;  a fair  operator  sends  with  a 10%  error  rate;  and  a 
poor  operator  sends  with  a 25%  error  rate. 

The  crossover  probability  e is  just  1 - P^,  where  P^ 
is  the  probability  that  the  matched-filter  demodulator 
announces  the  correct  mark/space  decision.  This  probability 
is  obtained  as  a function  of  SNR  by  computing  where 

Ejj  = signal  energy  during  an  element  duration  and  N^  = one- 
sided noise  spectral  density.  The  error  probability  e is 
then  obtained  from  the  performance  curve  for  the  probability 
of  error  using  either  coherent  or  envelope  detection,  as 
appropriate,  followed  by  a matched  filter  [6] . 

The  channel  shown  in  Figure  3 may  be  converted  to  the 
equivalent  binary  symmetric  channel  shewn  in  Figure  4 by 


Figure  4.  Equivalent  HKM  BSC 


defining  the  equivalent  crossover  probability,  e 


Egg  = p(l/0)  H p(0/l)  = e + 6 - 26e 


Clearly  if  5 = 0 (perfect  keying),  then  = e,  and  if 
e = 0 (perfect  demodulation),  then  = 5. 
Since  this  channel  is  symmetric,  capacity  is  achieved  by 
assigning  equiprobable  input  binary  symbols , and  is  given 


C = 1 + log  e__  + (1  - e ) log  (1  - e ) . 

eq  ^ eq  eq  eq 


Table  IV  gives  the  channel  capacity  as  a function  of  signal 
speed  and  SNR  for  the  RAM  signal  using  envelope  detection. 


C.  CALCULATION  OF  LOWER  BOUNDS  FOR  LETTER-ERROR  PROBABILITY 
A lower  bound  average  letter  error  rate  is  easily  obtained 
by  using  the  Straight-line  Bound  for  a binary  symmetric 
channel  [4,  p.  163],  To  use  this  bound,  it  is  necessary  to 
know  the  number  of  codewords  in  the  code,  and  the  length 
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TABLE  IV 


HKM 

Channel 

Capacity 

as  Function  of  Speed 

and  SNR 

Speed 

SNR 

E/No 

C 

(wpm) 

(dB) 

(lOOHz) 

(dB) 

(Envelope  Det) 

50 

12 

15.8 

2 X lO"^ 

~1.0 

9 

12.8 

2.5  X 10“^ 

.975 

6 

9.8 

2.7  X lO"^ 

.821 

3 

6.8 

1.1  X lO"^ 

.500 

0 

3.8 

2.3  X lO"^ 

.222 

30 

12 

18 

<io“^ 

~1.0 

9 

15 

1.3  X 10“'^ 

.998 

6 

12 

6 X 10“^ 

.947 

3 

9 

4.5  X lO"^ 

.735 

0 

6 

1.3  X 10"^ 

.443 

20 

12 

19.8 

< lo"^ 

~1.0 

9 

16.8 

<io"^ 

~1.0 

6 

13.8 

7 X 10“'^ 

.992 

3 

10.8 

1.6  X 10”^ 

.882 

0 

7.7 

8 X 10“^ 

.598 

(in  binary  digits)  of  the  codewords.  Additionally  this 
bound  only  applies  to  stationary  block  codes,  requiring 
construction  of  an  equivalent  stationary  block  code  for 
Morse,  which  in  reality  is  a code  which  produces  variable 
length  word  sequences.  Given  an  equivalent  block  code  the 
appropriate  relationship  for  the  probability  of  codeword 
error,  P^,  is  given  by: 
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^ Z A.  ] e (1  - e 
M "k,m  eq'  eg 


N-k 


+ 2 (JJ)  e“_  (1-e  , 

n=k+l  ^ 


where 


N = codeword  length 


M = no.  of  codewords 


,N. 


(;;)  ; 0 < n < k-1 


n,m 


0 ; k+1  < n < N 


and  k is  chosen  so  that 


M 


k-1 

E 

n=0 


M 


m=l  ' 


m 


= 2^; 


0 < 


^ N 

^ 'k>- 

ni=i 


This  result  for  is  for  a block  code  with  M codewords, 
each  of  length  N bits  transmitted  over  a BSC  with  error 
probability  The  problem  then  is  to  construct  a block 

code  which  is  equivalent,  in  some  sense,  to  the  variable- 
length-codeword  Morse  code,  then  to  determine  the  number  of 
codewords  and  the  length  of  the  codewords  for  this  equiva- 
lent code.  Clearly  the  complexity  of  this  equivalent  block 
code  will  depend  on  how  one  chooses  to  model  the  human  Morse- 
encoding process  for  the  design  of  the  decoder,  i.e.,  encoding 
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symbol-by- symbol;  symbol  pairs,  triplets,  etc.,  letter-by- 
letter, letter  pairs,  3-letter  words,  5-letter  words,  etc. 
Additionally  the  codewords  must  be  chosen  so  that  the 
resulting  encoded  sequences  are  stationary  in  order  to 
state  that  the  statistical  expectation  represented  by 
is  the  same  as  the  expected  letter  error  rate  (expectation 
over  time) . This  stationarity  can  be  ensured  by  requiring 
the  encoded  sequence  to  begin  at  a random  point  within  a 
source  letter  [7] . Such  a requirement  is  equivalent  to 
stating  that  the  decoder  is  not  synchronized  with  the  encoder 
on  a letter  basis;  that  is,  the  decoder  has  no  a-priori 
knowledge  of  the  beginning  and  ending  of  a letter  of  the 
variable-length  word  sequence  produced  by  the  Morse  code. 

Consider  first  the  construction  of  an  equivalent  block 
code  for  Morse  which  is  assumed  to  be  encoded  as  a symbol 
pair.  Table  V shows  the  variable-length  Morse  codewords 
for  this  code.  An  equivalent  set  of  equal  length  block 
codewords,  on  the  basis  of  equal  average  codeword  length, 
is  shown  in  Table  VI.  It  is  to  be  noted  that  some  code- 
words cannot  follow  other  codewords  in  an  encoded  sequence. 
For  example,  the  sequence  101011  cannot  be  followed  by 
any  codeword  except  those  beginning  with  10  since  the 
sequence  11  and  the  sequence  1111  are  not  allowable  Morse 
sequences . 

In  principle,  the  same  procedure  can  be  followed  to 
obtain  the  set  of  codewords  for  any  desired  codeword  length. 
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TABLE  V 

Variable-Length  Codewords  For  Symbol  Pairs 


Morse  Symbol 


Channel  Code 


1110 

1000 

111000 


— 0111 

0001 

000111 

Average  No.  of  Channel  Bits  Per  Morse  Codeword; 


TABLE  VI 

Equivalent  Four-Bit  Channel  Mode  For  Symbol  Pairs 


0000 

0001 

0010 

0011 

0100 

0101 

0111 


1000 

1010 

1011 

1100 

1101 

1110 


No.  of  Codewords: 


For  sequence  lengths  greater  than  about  12,  however,  the 
sheer  number  of  possibilities  makes  this  procedure  intrac- 
table. For  obtaining  codeword  sets  for  an  encoder  which 
encodes  combinations  of  more  than  one  source  letter  at  a 
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time,  then,  another  procedure  is  used.  Although  this 
procedure  does  not  obtain  all  the  codewords  in  the  equiva- 
lent block  code  set,  it  obtains  almost  all  of  them  and 
thus  represents  a lower  bound  on  the  actual  number  of 
codewords . 

The  average  Morse  code  sequence  is  7.27  symbols  in 
length.  For  a Morse  code,  however,  the  sequence  length 
in  Morse  symbols  must  be  an  even  number  (it  must  begin  with 
a mark  and  end  with  a character  space) . By  choosing  an 
average  of  8 symbols/character  for  the  equivalent  block 


7 1 
1 1 


I 


code,  and  by  requiring  that  the  8th  symbol  be  a character- 


space,  then,  it  can  be  seen  that  it  is  impossible  to  produce 
a sequence  of  a Morse  symbols  which  does  not  represent  some 
character.  It  is  also  obvious  that  not  all  characters  are 
represented  by  this  code.  Now,  of  the  four  symbols,  only 
two  are  allowed  in  any  one  position  of  the  sequence  (since 
space  follows  mark  invariably  and  vice  versa)  thus  the 
possible  number  of  synchronous  Morse  sequences  on  this  basis 

7 

is  2 = 128,  and  the  minimum  length  of  the  codewords  in 
binary  digits  is  8 x 1.76  = 14.  To  obtain  the  full  set  of 
nonsynchronous  codewords,  each  codeword  is  shifted  one  bit 
at  a time  and  a one  or  zero  appended,  if  allowable,  until 


A'-i  - -t 


SO  only  three  additional  codewords  are  obtained:  1010..., 
0010...,  and  1110....  In  general,  those  codewords  beginning 
with  a dot  (10)  produce  eleven  additional  codewords,  and 
the  codewords  beginning  with  a dash  (1110)  produce  eight 
additional  codewords.  If  = number  of  synchronous  code- 
words, then  M /Z  = no.  of  codewords  beginning  with  a dot 

S 

(dash) , so  the  total  number  of  nonsynchronous  codewords 
is  given  by 


M = 19  Mg/2  + Mg  = 10.5  Mg  j 


Table  VII  gives  the  number  of  binary  codewords  (M)  and  the 

codeword  length  (N)  for  the  encoding  procedure  of  interest. 

For  N _<  12,  M and  N are  exact,  as  computed  by  the  first 

procedure  discussed  above.  For  N > 12,  M and  N are  lower 

bounds  obtained  by  the  second  procedure.  Using  these  values 

of  M and  N,  the  lower  bound  on  P as  a function  of  e „ is 

e eq 

obtained.  This  value  for  P is  the  error  rate  over  a code 

e 

of  M codewords,  and  for  the  case  of  single  character  encoding, 
is  the  same  as  the  average  letter  error  rate.  For  other 
cases  of  source  alphabet  models,  however,  P^  does  not 
represent  the  letter  error  rate,  since  letters  consist  of 
more  or  fewer  than  one  codeword  depending  on  the  length  of 
the  codeword.  To  determine  the  letter  error  rate, 
consider  the  following  arguments. 
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TABLE  VII 

Equivalent  Block  Codeword  Set  Size  And  Length  For  Morse  Code 


Encoder 

Symbol  Pair 
3- symbol 

Single  letters  (exact) 
Single  letters  (bound) 
Double  Letters 


3-letter  words 


1,344 

139,264 

22,020,096 


Case  1:  Letters  consisting  of  two  or  more  codewords. 

For  this  case,  the  distribution  of  codeword 
error  events  per  letter  is  binomial  with  parameter  P^. 

Let  m be  the  number  of  codewords  per  letter.  Then  the 
probability  of  exactly  k error  events  per  letter  is  given 
by  (?)  P^^  (1  - P^)"*  and  the  probability  of  at  least 
one  error  event  per  letter  (i.e.  the  probability  of  a 
letter  error)  is  given  by  Ej^  = 1 - (1  - Pg)"** 

Case  2 : Codewords  consisting  of  n letters . 

In  this  case,  E^^  is  lower  bounded  by  assuming 
that  a codeword  error  event  causes  a single  letter  error 
within  the  codeword;  then  E^^  = Pg/n. 

Figures  5-7  show  plots  of  the  lower  bound  on 
average  letter  error  rate,  E^^,  as  a function  of  SNR  and 
keying  quality  for  several  levels  of  assumption  about  the 
Morse  encoding  process. 
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©HUMAN  OPEFATOR  (LAB) 

[Ref.  2] 

A HUMAN  OPERATOR  (CaH  LINK) 
[Ref.  1] 


1)  SYMBOL  TRIPLETS  (33,6)  CODE 


FIGURE  5 . Lower  Bounds  on  Letter  Error  Rate  for 

Morse  Code  - KMl  Signal,  Coherent  Detection 


GOOD  KEYING 

(SENDING  ERROR  RATE  = 1%) 


(D-  FAIR  KEYING 

(SENDING  ERROR  RATE  = 10% 


FIGURE  7 


Lower  Bounds  on  Letter  Error  Rate  for 
Hand-Keyed  Morse,  Envelope  Detection, 
Random  Letter  Source 


4 

I 

In  this  section,  a general  model  structure  which  accounts 
for  message  context,  sender  operator  errors,  variation  in 
date  rate,  and  variability  of  element  duration  is  constructed 
Further  it  is  shown  that  various  special  cases  of  this 
model  result  in  processes  for  which  optimum  estimation 
algorithms  and  decoders  have  been  treated  in  the  literature, 
some  from  the  point  of  view  of  optimal  estimation  theory 
and  others  from  an  information  theoretic  viewpoint. 

Fundamentally  the  model  that  is  constructed  is  a sliding 
block  coder  (SBC)  with  infinite  memory.  However,  instead 
of  encoding  the  letters  of  the  text  into  the  Morse  symbols 
either  noiselessly  or  with  a fidelity  criterion,  the 
encoding  process  is  considered  as  a probabilistic  mapping 
of  the  output  of  the  SBC.  The  complexity  of  the  SBC  is 
determined  by  the  degree  to  which  the  Morse  message  is 
desired  to  be  modeled,  from  the  simplest  case  of  independent 
symbols  to  a highly  complex  syntatic  and  semantic  model. 

While  specific  complex  models  of  a Morse  message  are  not 
developed  in  this  investigation,  the  structure  for  imple- 
mentation of  such  models  is  provided  by  the  general  model. 
Thus  the  structure  proposed  represents  a unified  approach 
to  modeling  the  Morse  message  from  the  simplest  case  to 
the  most  complex. 
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A.  BASEBAND  HKM  SIGNAL  PROCESS 


The  desired  representation  of  the  discrete-time  baseband 
HKM  process  is  a sequence  of  I's  and  O's  who^e  pattern  of 
occurrence  closely  resembles  that  of  a human  operator  sending 
a Morse  text.  By  considering  intuitively  how  a sending 
operator  may  encode  the  letters  of  the  text,  the  random 
variables  which  influence  the  human  encoding  procedure  can 
be  recognized.  Figure  8 is  useful  for  visualizing  this 
process . 


Figure  8.  Morse  Encoding  Process 

At  some  time  k,  one  or  more  letters  of  the  text, 
are  encoded  into  a sequence  of  code  words  a^,  consisting 
of  the  Morse  symbols.  The  human  operator,  however,  does  not 
always  send  the  proper  Morse  sequence  for  a given  sequence 
of  letters;  typical  mistakes  are  insertions  and  deletions 
of  one  or  more  symbols  (particularly  dots) , and  substitutions 
of  one  symbol  for  another  (particularly  word-spaces  for 


(2) 


the  memory  associated  with 
encoding ; 


“k  * *a<»k’“k-l>' 


\ ■ *X**k'^k-l’' 


the  memory  associated  with  the 
source , 


where 


“k  ^ ^^i'  ^ ~ 

Xk  e {Mj^;  i = 1,2 


},  the  set  of  key  memory  states; 


},  the  set  of  encoder  memory  states; 


},  the  set  of  source  (message) 
states. 


Then  the  state  of  the  process  at  time  k is  specified  by  the 
vector: 


T 

[ ^ ^k  ^ ^k  ^ ^k  ^ ^k  ^ ^k  ^ ^ 


where 

-k  " ^^k'^k'^k^"^' 

For  example,  if  f^  counts  the  number  of  samples  since  the 
last  keystate  transition,  f^  counts  the  number  of  symbols 


r 

\ i 

i ^ 


sent  since  the  last  letter  transition  and  records  the 
previous  letter,  then  a specification  of  the  state  vector 
gives  the  current  key  state,  code  symbol,  and  letter  being 
sent,  along  with  the  amount  of  time  the  key  has  been  in  its 
current  state,  which  symbol  of  the  Morse  code  sequence  for 
the  letter  is  being  sent,  and  the  previous  letter. 

To  introduce  the  randomness  associated  with  sending 
errors  and  variation  in  data  rate,  let  a random  control 
vector  be  defined  which  selects  the  Morse  code  sequence  for 
the  letter  being  transmitted,  controls  the  instantaneous 
data  rate,  and  the  average  speed  of  sending; 


— k ^ i'  ^ ” 1,2,...M},  the  set  of  control  vectors, 


The  complete  state  vector  is  now  given  by 


^k 

Hk 

^k 


= t^k  ^k  \ \ “k  ^k^*^ 


The  probabilistic  evolution  of  the  states  of  the  process 
will  be  fully  specified  when  the  following  transition 
probabilities  are  determined: 

Prts.  = S.,  u,  = U . , 0,  = E |s,  , = S_,  Oj,  1 = 
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i < 


i i 


where 


{Sj^;  i = 1, 2 , . . . R} 


is  the  set  of  all  state  values. 


eUld 


{E^7  1 — 1,2,«>.Q} 


is  the  set  of  all  memory  states. 


This  state  transition  probability  matrix  is  now  derived 


in  terms  of  the  components  of  the  vector  s^. 


Let  the  evolution  of  the  keystate , which  is  dependent 
only  on  its  present  and  past  inputs  and  its  past  outputs 
be  described  by  the  transition  probabilities: 


(4)  P(xj^|aj^  = Pr[Xj^  = Kja,^  = A.,  = A^,  = B,^] 


Similarly  the  evolution  of  the  encoded  letters  a^^  from  the 
decoder  is  dependent  on  the  present  and  past  inputs  to  the 
encoder  and  on  its  past  outputs,  but  it  is  also  dependent 
on  the  history  of  the  keystate,  since  the  code  symbol  being 
keyed  cannot  be  changed  until  the  current  symbol  has  com- 
pleted keying.  The  transition  probabilities  describing  the 
encoder  function  then  are  given  by: 


(5)  p(a^|U|^  8^.^)  . Prla„  = - 0., 

^)c  ~ ^lc“l  ^ ^ ^ ^lc”l  ~ * 
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The  evolution  of  letters  from  the  source  is  dependent  on 
the  history  of  the  message  text,  but  it  is  also  dependent 
on  the  history  of  the  encoding  process,  since  the  letter 
being  encoded  cannot  be  changed  until  the  current  letter 
has  completed  the  encoding  procedure.  The  transition 
probabilities  for  the  source  then  are; 


(6)  P(^kl  Vi  '^-i)  = = "'ii  Vi  = Mj'  “k-i  = V 


The  control  vector  Uj^  is  modeled  as  a conditional  Markov 
chain,  conditioned  on  ' accounting  for  the 

dependence  of  operator  sending  peculiarities  and  data  rate 
on  message  context,  message  duration,  traffic  type,  etc. 
The  transition  probabilities  for  this  model  are: 


(7)  P(Uk|u^.i  ^ Prtu,^  = = U . , 

“k-1  " ^m'  ®k-l  “ ®n'  ^k-1  ^ ^p^ 


In  terms  of  the  abbreviated  notation  defined  by  expressions 
(4)  through  (7)  above,  the  state  transition  matrix  is  given 
in  terms  of  the  components  of  the  state  vector  Sj^  by: 


p(Sj^  Uj^  lik-i  £.k-l^  ■ P^^k  ®k  ^k  “k  ^k  ^k  ^ik^ 


Xk_i  ^‘k-l  ^k-1  ^k-1  ^-1^ 
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Invoking  the  independence  of  appropriate  variables  argued 
in  writing  expressions  (4)  - (7) , this  expression  reduces  by 
the  chain  rule  to: 


(8)  p(s^  Uj^  £lc Ilk-1  Ik-l’  = P'^'kl^k  ®k-l  “k-l>  • P<®kK  ®k-l> 

• P'^kl^  !ic  “k-1  Vl  ®k-l>  • P'^kl^k  “k-l> 

Pdkl^k-l  “k-1*  ■ P*^kl\  V-1* 

• P(!lk Ilk-1  “k-1  *k-l  ^k-l>- 


Now  the  expressions  for  the  transition  probabilities  of 
^k'  ^k'  ^k  given  by  the  following  due  to  definitions 
(1)  - (3): 


p<®ki'‘k  ®k-i>  ' 


p'“ki“k  “k-i>  “ 


p»ki*k\-i>  = 


1,  if 


0,  otherwise 


1,  if  Ai  = f<.(Aj,A„) 


0 , otherwise 


1,  if  (Lj 


0,  otherwise 
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For  example,  if  the  function  is  sufficiently  complex 
and  clever,  the  entire  past  context  of  a message  may  be 
accounted  for  in  assignment  of  the  letter  transition 
probabilities.  In  the  simplest  case,  the  assumption  is 
made  that  f^  h o,  and  uniform  probabilities  are  assigned  to 
the  letter  transitions.  The  next  level  of  complexity  is  to 
assume  that  f^  = allowing  a Markov  model  for  the  letter 

transition  probabilities.  Considerably  more  complex  is  a 
model  which  recognizes  that  certain  sequences  of  letters 
are  always  followed  by  a known  sequence  in  certain  formatted 
messages.  The  most  sophisticated  model  for  this  function 
is  one  which  models  the  structure  of  the  Morse  code  message 
as  a natural  language,  requiring  construction  of  syntatic 
and  grammar- like  rules  which  are  used  to  parse  the  message 
into  meaningful  sequences  of  letters  and  words . Such  a 
model  would  obviously  require  a highly  complex  f^. 

At  the  next  level,  that  of  encoding  the  letters  into 
the  mark/space  durations  consistent  with  the  dot/dash/space 
Morse  sequence  for  the  letter,  any  level  of  sophistication 
and  cleverness  for  the  f^  function  may  be  used,  together 
with  the  model  for  the  vector  control  variable  u.  It  is 
at  this  point  that  operator  inconsi stanoies  such  as  deletion, 
substitution  and  insertion  of  Morse  elements  can  be  accounted 
for.  Additionally,  by  proper  construction  of  the  f^  function, 
one  may  also  account  for  variations  in  weight  (average 
dot/elem-space  ratio),  sending  speed,  and  known  conditional 


relationships  between  the  ratios  of  current  to  predecessor 
element  durations.  In  the  simplest  case,  the  assumption  is 
made  that  the  operator  always  encodes  perfectly  and  that 
his  element  durations  are  consistent.  This  simple  case 
would  apply  to  machine-sent  Morse  code  and  corresponds  to 
the  situation  where  u = constant,  and  f = a,  , . 

At  the  key,  the  durations  a^^  are  converted  into  the 
0,1  logic  levels  of  duration  roughly  equal  to  that  produced 
by  the  encoder.  The  hximan,  however,  cannot  always  produce 
these  durations  consistently;  thus,  the  time  duration  in 
a particular  state  will  be  random,  with  mean  value  roughly 
equal  to  the  du:  ations  produced  by  the  encoding  process, 
and  with  a variance  inversely  proportional  to  his  proficiency 
and  concentration.  There  are,  for  example,  certain  con- 
ditional relationships  which  have  been  found  to  be  true  for 
almost  every  operator;  in  particular,  inter-element  dots 
are  more  consistently  produced  than  beginning  or  ending  dots. 

At  this  point,  also,  the  effect  of  the  type  of  key  used 
by  the  operator  may  be  accounted  for.  Hand-keys,  mechanical 
bugs,  and  electronic  bugs  all  produce  different  duration 
statistics  for  the  same  operator  with  the  same  message. 

The  purpose  of  this  research  is  not  to  derive  sophis- 
ticated models  for  the  f-functions,  but  to  derive  a result 
which  shows  in  general,  whatever  model  is  used,  how  the 
concepts  of  context,  message  formatting,  operator  encoding 
anomalies,  and  operator  "fist"  modeling  may  be  included  in 
a unified  framework  to  produce  at  the  receiver  an  optimal 
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estimate  of  the  transmitted  text.  The  extent  to  which  the 
output  translated  text  is  an  accurate  reproduction  of  the 
transmitted  message  is  clearly  a function  of  the  sophis- 
tication and  accuracy  of  the  model  used. 

The  results  of  this  development  of  the  model  are  summar- 
ized in  the  following  simple  theorem. 

Theorem 

Let  Sj^  be  an  n-dimensional  discrete-valued  random  vector 

with  finite  state-space:  {S^;  i = 1,2,...N}. 

Let  be  an  m-dimensional  discrete-valued  random  vector 

with  finite  state-space:  {U^;  i = 1,2,...M}. 

Let  Z,  be  an  r-dimensional  discrete-valued  random  vector 
k 

with  finite  state-space:  {A^;  i = 1,2,...R}. 

Define  the  function  f : S,  x E,  ->•  E,  such  that 

o k k k 

' where  are  realizations  of  the  random 

processes  respectively. 

Let  the  probabilistic  evolution  of  the  tij^  process  be 
described  by  the  following  conditional  Markov  process : 

P<"kl“k-1  °k-l'  ' PpK  = “jIVl  ' “m'  “k-1  = 

ClXX  J f ill  f • 

Let  the  probabilistic  evolution  of  the  S^^-process  be 
described  by  the  following  conditional  probabilistic  mapping 
of  the  Uj^-Markov  process: 
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“kl“k-l  "k-l'  ' p'^kl^k  “k-1  “k-l>  • p<“kl“k-l  “k-l' 


Corresponding  the  terms  on  the  right-hand  side  with  the 
processes  described  above,  and  expression  {9b)  with  the 
function,  the  theorem  is  proved. 
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Corollary 


Let  the  function  f be  invertible  in  the  sense  that 

a 

®k  “ ^as'^ ^^k'^k-1^  uniquely  defined. 

Then  the  output  state  of  the  HKM  process  is  a sliding 
block  encoding  of  the  sequence  Sq,Sj^,S2  ...  where  the 
evolution  of  the  Sj^  process  is  described  by  the  conditional 
mapping: 

P^^kl'^k-l  '^k-1^  “ ^^^®k  ®il’^k-l  " ' '^k-l  " V 


and  the  process  is  described  by: 


P^'^kl'^k-l  “^k-l  ^k^  = ^^f^k  = ^il'^k=l  = ^j'^k-1  = ^ 


m 


a,  = A ] . 
k n 


Proof:  From  the  main  theorem,  the  state  is  describeable 

as : 


= ^®k-2' 


f 


I 

which  can  be  expressed  in  terms  of  a new  function  f^  as 


' ^a^®k'®k-l'®k-2' 


,Si,ao) 


58 


I 

I Now,  defining  Oq  s Sq,  which  is  consistent  with  (9b)  since 

i is  arbitrary,  then  represents  a sliding  block 

encoding  of  the  sequence  {s^},  i = 0,1, ..,k. 

Now  {9a)  can  be  expressed  as: 

p(Sj^  “^k-l^  ” ^^'^kl'^k-1  “^k-l  ®k^  * ^^®k^^k-l  ^k 

and  by  the  corollary  hypothesis  on  the  invertibility  of  f^, 

« 

= “^k-l  ^as~^^'^k''^k-l^  ^ * P^®kl'^k-1  '^k-l^  * 

But  \iy^  is  already  conditioned  on  so  the  additional 

conditioning  provided  by  is  exactly 

that  provided  by  o^,  thus  (9a)  is  reduced  to: 

p{Sk  '^kl'^k-1  '^k-1^  ■ ^^'^kl'^k-1  ^k-1  '^k^  * P^^kl'^k-l  '^k 

which  are  the  two  processes  hypothesized,  proving  the 
corollary. 

Conunents:  The  theorem  and  corollary  are  interesting  pri- 

marily from  a theoretical  viewpoint.  The  main  theorem 
actually  does  no  more  than  place  the  intuitively  developed 
model  for  the  HKM  process  on  a solid  probabilistic  founda- 
tion. In  Section  V,  where  an  optimal  estimator  for  the 
state  of  the  process  is  derived  through  Bayesian  techniques 
the  form  of  the  model  presented  in  the  main  theorem  is  that 
which  is  used.  However,  after  the  estimation  algorithm  has 


been  deri^'ed,  it  is  shown  that  the  optimal  estimator  has  a 
trellis  structure,  which  is  not  surprising  in  view  of  the 
corollary  result  showing  an  SBC  interpretation.  The  block 
diagram  shown  in  Figure  9 is  useful  for  visualizing  the 
evolution  of  the  output  state,  Sj^. 

B.  BASEBAND  HKM  CHANNEL  MODEL 

Although  the  channel  model  for  the  HKM  process  described 
in  Section  III  was  useful  for  obtaining  lower  bounds  an 
error-rate  performeuice,  it  is  of  little  use  in  actually 
describing  the  physical  processes  which  affect  the  reliable 
transmission  of  a Morse  message.  Consider  the  following 
simplified  model  of  the  communication  channel  for  Morse 
transmitted  at  HF.  The  keyer  turns  the  transmitter  on  and 
off  according  to  the  HKM  source.  When  keyed,  the  transmitted 
RF  signal  has  amplitude  C(t)  at  a carrier  frequency  to.  The 
HF  propagation  channel  introduces  both  additive  noise  {N(t)) 
in  the  form  of  atmospherics  and  interference,  and  multipli- 
cative noise  (B(t))  in  the  form  of  fading  and  multipath 
propagation  effects.  At  the  receiver,  the  carrier  is 
removed  after  being  band-pass  filtered  and  gain-controlled. 
After  low-pass  filtering  and  sampling,  the  baseband  signal 

gain-controlled  received  signal  amplitude;  is  the 
sampled,  gain-controlled,  low-pass  filtered  effective 
multiplicative  noise  component;  and  n^^  is  the  low-pass 
filtered  version  of  the  additive  noise. 
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FIGURE  9.  Block  Diagram  of  HKM  Signal  Model 


I 


i 

j The  sampled  version  of  the  cunplitude  of  the  transmitted 

carrier  Cj^  is  a constant  value  while  Xj^  = 1 . During  the 
period  when  = 0,  the  amplitude  will  remain  constant  at 
the  same  value  as  for  Xj^  = 1 for  a large  percentage  of  the 
time.  However,  it  is  not  uncommon  for  the  operator  to  go 
into  a pause  during  which  time  he  readjusts  the  transmitter 
power  either  up  or  down.  These  adjustments  are  usually 
made  between  messages,  but  also  can  occur  during  a short 
pause  between  letters.  Thus  the  signal  carrier  amplitude 
is  a random  variable  with  a transition  probability  density 
which  is  conditioned  on  the  memory  of  the  HKM  process  and 
the  current  key  state.  In  the  simplest  case,  the  model  may 
be  made  conditional  only  on  Xj^  and  having,  as  a con- 

sequence, the  result  that  the  carrier  amplitude  is  allowed 
to  change  randomly  during  every  0-state  duration.  More 
realistically,  one  level  of  complexity  greater  allows  the 
i transition  probability  to  be  conditioned  on  such  that 

the  amplitude  can  change  only  when  indicates  a pause. 

The  effect  of  transmitter  power  fluctuations  at  the  output 
of  the  receiver  is  dependent  on  SNR  and  on  the  AGC  employed 
for  gain- leveling.  For  moderate  to  high  received  SNR,  the 
effective  c.^  observed  at  the  receiver  output  stays  relatively 
constant  because  of  AGC  action.  However,  when  noise  power 
becomes  a significant  portion  of  the  total  power  controlling 
the  AGC,  then  c^^  varies  nearly  the  same  as  Cj^.  Thus  an 
efficient  model  of  transmitter  power  fluctuations  must  take 
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I 

;■  I 

f J 

f , 

I I into  consideration  not  only  the  actual  power  variations  of 

the  transmitter,  but  also  the  effect  of  the  receiver  RF, 

i 

^ IF,  and  AGC  sections  as  well. 

Consider  now  the  multiplicative  noise  term,  which  has 
i the  observable  effect  of  varying  signal  amplitude.  If  it 

I arises  because  of  relatively  slow  fading,  then  its  effect 

\ will  be  cancelled  by  the  combination  of  AGC  and  low-pass 

i 

i filtering.  If,  on  the  other  hand,  it  is  caused  by  fast 

fading  (perhaps  due  to  multipath) , then  the  AGC  cannot 
respond  fast  enough  to  keep  the  output  signal-level  constant. 
On  eui  OOK  signal,  the  effect  is  the  same  as  if  the  trans- 
mitter power  were  changed  during  the  carrier  off-time. 

The  term  then,  represents  an  effective  transmitter 

power  fluctuation,  dependent  on  both  the  HKM  process  and 
the  HF  channel,  with  the  result  that  the  marks  of  the  HKM 
process  appear  to  be  transmitted  with  random  amplitude. 

^ I During  the  period  of  a MARK,  the  effective  fluctuations 

are  caused  by  the  slow  fading  component  with  intensity  and 
rate  determined  by  the  channel,  the  AGC,  and  the  low-pass 
filter. 

In  view  of  the  above  consideration,  it  is  appropriate 
to  model  the  apparent  transmitted  amolitude  v,  as  a condi- 
tional  gauss-Markov  process,  dependent  on  both  the  HKM 
process,  and  the  channel: 

(10a)  y(k)  = YF(Sj^  '^k-l^  y(k-l)  + r(Sj^  '^k-l^ 


where  (k)  is  a zero-mean  gaussian  random  sequence  with 
unit  variance; 


P(s^  aj^_l)  is  a function  of  the  state  of  the  HKM  source; 


r(Sj^  0k_l)  is  a similar  function. 


Y is  a channel-dependent  fading  parameter. 


Now,  since  the  amplitude  is  observed  only  during  a MARK 
period,  the  measurement  equation  is  given  by; 


(10b) 


^k  = ""k^k  '"k' 


where  nj^  is  the  low-pass  filtered,  gain-controlled  channel 


noise. 


Equations  (10)  represent  the  described  HKM  Baseband 
channel  model,  which  accounts  for  the  effects  of  fading  on 
an  OOK  signal  and  the  effect  of  actual  transmitter  power 
fluctuations  caused  by  the  sending  operator. 

Generalizing  these  intuitive  concepts  to  a vector 
channel  results  in  the  following  channel-measurement  model. 
Consider  that  the  output  sequence  s^  of  the  HKM  is  observed 
through  the  following  channel  and  measurement  processes : 


^k-i  * ''<=k  '’k-i>  “k 


^ “ '“=k>  ^k  "k 


where 


is  a p-dimensional  state  vector; 
is  a q-dimensional  measurement  vector; 
J(Sk  is  a p X p state  transition  matrix; 

H(Sk)  is  a q X p measurement  matrix; 

r(Sk  is  a p X p matrix; 

Wk  is  a p-dimensional  plant  noise  vector; 

n,  is  a q-dimansional  measurement  noise 

vector; 

Wk  is  statistically  independent  of  w^^^  for  2,  ^ k; 
nk  is  statistically  independent  of  n^^  for  I ^ k; 

Wk  is  statistically  independent  of  nk/* 
p (Yq) ,p (Wk) fP (nk)  are  given  probability  densities. 


It  is  to  be  noted  that  this  observation  model,  when  con- 
ditioned on  is  linear.  Further  if  the  probability 

densities  are  gaussian,  then  the  Sk  " conditional 

estimate  of  yk»  given  the  sequence  Zk»  k = 1,2,...,  is 
given  by  the  well-known  Kalman  filter  recursions. 


k 
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V.  THE  ESTIMATION  PROBLEM 


The  estimation  problems  of  interest,  based  on  the  HKM 
source,  channel,  and  measurement  models,  can  be  divided 
into  two  broad  classes.  The  first  results  when  the  HKM 
transition  and  mapping  probabilities  are  known  a-priori 
for  all  k;  the  problem  then  is  to  find  an  optimal  (in  some 
sense)  estimator  for  Sj^  and/or  Uj^  given  noisy  observations. 

It  will  be  shown  that  the  desired  estimator  is  not  physically 
realizable  in  general  because  it  requires  an  exponentially 
expanding  memory.  In  Section  VIII,  however,  practical 
realizations  of  a suboptimal  estimator  are  discussed,  and 
it  is  shown  that  one  can  systematically  come  as  close  to 
optimal  estimation  as  desired.  The  second  class  of  estima- 
tion problems  results  when  the  HKM  model  probabilities  are 
known  only  to  the  level  of  an  initial  probability  distribu- 
tion. The  problem  here  is  to  estimate  s^^  and/or  Uj^  and 
the  transition  auid  mapping  probabilities  themselves.  Only 
the  first  class  will  be  treated  here. 

In  this  class  of  estimation  problems,  the  transition 

and  mapping  probabilities  are  specified,  and  the  problem 

is  to  estimate  the  state  of  the  system  at  time  k,  given 

k A 

the  sequence  of  all  past  measurements  z = {zj^,Z2, . . . ,2^}. 

The  state  estimate  of  the  system  is  given  by  the  joint 
estimate  of  the  output,  control,  and  memory  states  Sj^  Uj^ 

The  problem  of  obtaining  an  optimal  estimate  of  the  state 
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is  approached  in  the  traditional  manner;  that  is,  the 

(posterior)  conditional  probability  distribution 
k 

p(Sk  Uk  ) is  determined  for  all  k,  and  a suitable 

optimality  criterion  is  applied  to  this  distribution  to 
arrive  at  an  optimal  estimator. 

Using  the  Bayesian  approach  to  the  problem  of  obtaining 
the  posterior  distribution,  a recursive  form  for  the 
estimator  is  obtained.  It  will  be  shown  that  the  resulting 
structure  can  be  realized  by  a set  of  simpler,  identical 
filters,  operating  on  a tree  or  trellis.  In  the  case  of 
parameter-conditional  linear-gaussian  observation  and 
measurement  models,  these  "elemental"  filters  are  Kalman 
filters.  In  case  the  observation  and/or  measurement  models 
are  not  linear-gaussian,  then  the  body  of  knowledge  on 
non-linear  filtering  can  be  brought  to  bear  on  the  design 
of  these  elemental  filters. 

A.  ESTIMATOR  DERIVATION 

In  the  following  it  will  be  necessary  to  keep  track  of 
both  the  time  index,  k,  and  the  state  value  indices  for  the 
states  Sk  e {S^},  Uk  e {U^},  e To  reduce  the 

notational  burden  which  would  result  from  the  explicit 
notation  of  probability  statements  such  as 

Pr[Sk  = Sj^lUk  = = ^m'^k-l  ^n^  ' following 

abbreviated  notation  will  be  used.  The  subscript  k is  the 
time  index,  and  the  superscript  is  the  index  of  the  set  of 
state  values.  When  k is  used  as  a superscript,  it  refers 
to  the  time  sequence  of  values,  0,1,2,. ..,k;  e.g.. 
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Ic  A 

z = Z]^Z2  •••  ^k’  Additionally  the  vector  notation  using 
an  underbar  will  be  dropped,  with  the  understanding  that 
all  variables  are  implicitly  vector-valued.  In  terms  of 
this  notation,  the  HKM  signal  and  observation  models  are: 


(11)  Output  State  Mapping  probabilities: 


P'=kl"k  “k-l  “k-l'  ’ "'=k  = ^ii^k  ' °j'“k-l  = °m’“k-l  " ''q' 


(12)  Control  State  Transition  probabilities: 


P(u3|u”-1  qg.j)  ^ Pr(U^  = ' ''q' 


(13)  Memory: 


^ f^(Si,Aq) 


(14)  Channel! 


I'k  = i<=k  “k-i’  ^k-i  * '■'^k  “k-i>  “k 


1 


(15)  Measurement! 


^k  ■ ®‘^k>  i'k  "k- 


The  well-known  Bayesian  procedure  (see,  for  example, 
Lee  [8])  for  recursively  determining  the  posterior  density 
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(distribution)  is  given  as  follows.  At  time  k-1,  the 
mixture  density: 


/ n m q I k-1.  _ , in  q 

P(yk_i  “k-l'^k-l'^  ^ ^ P^^k-l'  k-1  k-1  '^k-l'  ^ 


n m ^q  „k-l, 

11  rr”  • ‘T  1 


p'=k-i  <-i  -2-1 1 


has  been  obtained.  The  density  at  time  k,  after  receipt 
of  a new  measurement  z,  , is  given  by  Bayes'  rule: 


(16)  p(yj^  sj  uj 


p(Zklyk  sj  ujaj  z’'-^)p(yj^  sj  u^  a J 1 z 


i j 

nJ  n 


p(z,  lz^“^) 


where ; 


(17)  p(yj^  ®k  '^k  '^kl^  ^ ^ 


nmq 


f 

I , i j I ^ ,ni  a „k-] 

P^^k  ®k  '^k  ‘^k'^k-l  ®k-l  ^k-1  '^k-1' 


/ n m q I k-1.  , , 

• P^^k-l  ®k-l  '"k-l  '^k-ll^  ^ '^yk-l 


(18)  p(z^|z''"^)  = 


7.  f_  .i  ..i  I ,k-l, 


J pCyi,  3^  ^)p(z^|yv  sf  u^  a^;z  ^)  dy. 


IWPIIII,!  Jl»  .II.HPI  ■ w ' 

■ I -L..  J£  ^ - 


The  desired  state  posterior  probability  distribution 
then  is  obtained  from  (16)  by  integrating  over  yj^: 


I k-1 

Substituting  expression  (18)  for  p(2j^|z  ) into  (16), 

expression  (19)  becomes: 

//I  i j k-1.  , i j Jli  k-1.  , 

=lc  “k  “k  ^ ) P'^k  \ “k  ‘’kl’^  > '^k 

5s_ 

(20)  p(sj  uj  Oj^lz^)  = 

ij 

and  the  problem  is  to  obtain  a result  for  the  integral  over 
yj^  in  terms  of  the  prior  density  at  time  k-1,  and  the  model 
transition  probabilities. 

i "i  k— 1 

The  first  term  in  the  integrand,  P(z^|yj^  sj^  uj^  z ), 
is  readily  determined  from  the  measurement  equation  (15) 
and  the  density  of  the  noise,  case  of 

a white  sequence,  the  density  is  given  simply  by: 


(21)  pCz^l^k  ®k  ‘^k  ^k  ^ 


j ,k-l.  , 


Sv)  = Pn^^v  " H(si)y^)  . 


) - P(Zklyk  -k'  " ^n'^-k  ■ “'^k'-^k 


The  second  term  in  the  integrand  is  given  by  (17)  in 
terms  of  the  prior  density  and  the  transition  probabilities. 
Rewriting  the  mixture  densities  in  (17)  in  terms  of  the 
component  conditional  density  for  y^^  and  the  discrete 
distributions  for  Sj^  Uj^  expression  (17)  becomes: 
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jr 


/ 


(22)  p(yj^  sj  uj  cT^|z^"^)  = 

j 


nmq 


^k-l 


‘p'yki^k-i  =k 

j £,  n m ^q  „k-l. 

"k  “k  =k-i  \-i  “k-r^  > 

(a) 

k "k  p^^k-i  ^ 

nmq  _k-l. 

'k-1  ^k-1  ^k-1'^ 

(b) 

1 n m 

’k-ll®k-l  '^k-l 

q k-1. 

“k-i’^  ) 

(c) 

'k-1  '^k-1  ‘^k-ll 

dy^-i 

(d) 

Now  since  Sj^  Uj^  aj^  are  independent  of  the  density 

on  line  (c)  above  is  not  changed  by  writing; 


(e)  p(yk-ii^-i  vi  - p<yk-ii<  •i  < <-i  >^-1 


i j )l  n m q „k-lv 

rr  e m rr*  •T  I 


Also,  by  virtue  of  this  independence,  the  expression  on 
line  (b)  becomes; 


Combining  (a)  & (e) , substituting  (f ) for  (b) , and  rearranging 
the  terms  of  (22),  the  expression  becomes: 
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Jt.  . 


4 p<=k  4 <\4.i  4-1  4-1^  p<=!:-i  4; 


J 

^k-1 


^k-ll®k  '^k  ^k  ®k-l  '^k-1  '^^k-l* 


k-1. 


Carrying  out  the  integration  over  and  noting  that 

is  not  dependent  on  Uj^  Sj^_^  '^k-1'  desired  result 
for  expression  (17) , in  terms  of  the  prior  and  transition 
probabilities,  is  given  by; 

(23)  p(y^  sj  ' 


I p(si  uj  (rils?  , u™  ..'3  1 r,,=n  „q  .-k-l. 


n,m,  q 


'ic  '^ic  ''kl^k-i  ''k-i  <"k-i^  P^®k-1  "‘k-i  ''k-il^'  ^ 


• P(y]cl®k 


The  integral  in  (20)  is  then  given  in  terms  of  (23) 
and  (21)  as: 


(24)  ; P(k^|y^  u3  a'  P(y^  a‘|z‘'-^)  dy,^  = 

^k 


2 P(si  u?l  ailsj}  , u!"  -*5  ' -<3  i_k-l, 

nmq 


./ 


'ic  '^k  ‘"kl®k-i  '"k-i  ^k-i^  P^®k-i  "‘k-i  ^ ^ 

P(J^|y^  sj)  P(y„|sj  dy^. 
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U ! 


1 


The  resulting  integral  over  in  the  above  expression  is 
seen  to  be  a likelihood  function  since 


yjc 


^kl^k  ®k^  P^^kl^k  " P^^k^^k  ^k-1'^^”^^’ 


(25) 


Denoting  this  integral,  then,  as  the  likelihood, 
, iq  A I , I i.  , liq  k-1, 

= J P ' ® ' rif\7_  Ic  rr^  • *7  1 


p^^ki^k  p^^ki^  ^k-i'^  ’ ) ‘^yk' 


the  posterior  conditional  density  (20)  is  given  by  (24) 
& (25)  as 


V ^ /«i  j I m N , n m q c k-1.  , iq 

^ P<=k  “i!  °k  I Vi  \-i  “k-i’P'Vi  Vi  >v 

1 ,J  j,-k.  _ i23- 


p<=k “k  “ki^  > -I  ^ 

ij  nmq 


This  is  the  desired  result  for  the  recursive  calculation  of 


the  probabilities  of  the  states  Uj^  given  the  measurement 
k 


sequence  z . In  terms  of  the  model  transition  probabilities 
(11)  and  (12)  and  the  memory  function  (13)  , the  transition 
probabilities  are  computed  as : 


‘''“'k  “k  ''k'''k-l  “k-1  “k-1'  ~ 


3 I,,!" 


k'  k k-1  k-1  k'  k-1  k-1' 
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along  the  allowable  transition  paths  specified  by 


* IT  / 1 c[  , 


For  each  memory  state  and  control  state  value  at  time  k-1, 
the  transition  probability  “^k-l^  specified 

by  (12)  for  all  j,m,q.  Then  for  each  j,m,q,  the  mapping 
probability  p(s^|u^  '^k-l  ‘^k-l^  given  for  all  i by  (11); 
the  value  for  is  found  for  each  i,q  pair  by  (13)  , and 
is  computed  by  (25) . The  posterior  probadjilities  are 
then  computed  by  (26)  and  the  state  values  and  their 
probabilities  are  in  place  for  the  next  recursion. 

Clearly  the  ability  to  carry  out  the  recursion  (26) 
exactly  depends  on  whether  or  not  the  likelihood  (25)  can 
be  found  in  closed  form.  Such  a form  can  indeed  be  found 
for  the  linear  channel  and  measurement  models  (14)  and  (15) 
in  case  the  noise  n^^  is  white  and  gaussian,  as  will  now  be 
shown. 

First  note  that  the  densities  involved  in  the  expression 
for  the  likelihood  (25)  are  both  conditioned  on  specific 
realizations  of  Sj^  and  namely  s^^  = and 

The  first  density  P(Zj^|yj^  s^)  is  given  by  (21)  for  the  white 
noise  sequence;  for  the  white  gaussian  sequence,  (21)  becomes 

(27)  P{2,^|yj^  sj)  = p^(Zj^  - H(sJ)y(k))  = (H(sJ)y  (k)  ,R)  , 

}c 

where  N (m,V)  is  the  gaussian  density  with  mean  x = m, 

X 

variance  V and  p (n.)  = N (0,R). 
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k-1.  The  path  label,  then,  at  time  k,  resulting  from  the 


extension  of  the  path  labeled  A at  time  k-1,  is 


P(yklsJ  * j 

^k-l 


P^^kl^k-1  ®k  ^k-1'^^"^^ 


* P^^k-ll^k  ‘^^k-l 


and  since  the  s^  “^k-l  uniquely  embodied  in 

% X Cl  Ic*l 

Oj^  = fg(Sj^  ^k-1^  ' ^k-1  ^ independent  of 

Sj^,  the  above  expression  becomes 

<28)  p(y,^|o;^,-2'''h  = j P(y|,lYk.l  sj 

^k-1 

• P^^k-ll'^k-1'^^"^^  '^^k-l 


for  each  along  a path  given  by 


'^k  ^a^®k'°k-l^ 


Now  when  the  a-conditional  density  for  the  initial 
value  of  y.  is  gaussian  and  the  s,  a,  , - conditional 


it-. 


chemnel  model  is  linear  gaussian,  the  aibove  density  (28).  is 
gaussian  for  all  Jc,  and  the  mean  and  variance  of  the  density 
is  given  by  the  Kalman  filter  recursions. 

Specifically,  this  density  is  given  by 


(29)  P(y^|ajJ 


where 


J'jclit-l'At’  = A,)  y,,.l|,j.l(A„) 


- ?<Si  A„)  f (S.  A ) + Q^(S.  A ) 


At  - Aq) 


cind  the  recursions  for  given  by 

the  remaining  Kalman  filter  equations; 


t I 


Vh'  - \|)c-l<At)“’'<V'»<Si'''lt|)c-l<At)«’'<Sl)  + 


Substituting  these  expressions  (27)  and  (29)  back  into 


(25),  the  integral  to  evaluate  becomes: 
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‘■la  • / “z, 


yv  k 


The  evaluation  of  this  integral  is  a basic  exercise  in 
integration  of  gaussian  densities  and  is  given  by  [8] ; 


'k  k-1 


k k-1 


* f^klk-l^^il^n 


where 


'klk-l^^Jl^  " ^k  ■ “^®i^  ^klk-l^^Jl^ 


B.  IMPLEMENTATION  STRUCTURE  OF  ESTIMATOR 

The  structure  of  the  filter  realization  density  (26) , 
together  with  the  likelihood  calculation  (29) , is  that  of  a 
tree  with  nodes  given  by  the  past  state  trajectories  and 
with  branches  labeled  by  the  states  of  process.  For  each 
transition,  i.e.,  each  path  extension  to  a new  node,  the 
likelihood  of  the  transition  is  computed  from  the  Kalman 
filter  recvirsions  along  that  particular  path.  The  likeli- 
hoods are  multiplied  by  the  transition  probability  for  that 
path  extension,  and  by  the  previous  path  probability.  The 
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updated  path  probabilities  are  then  obtained  by  normalizing 
these  products.  The  tree  structure  showing  the  evolution 
of  the  path  labels  according  to  a particular  function  is 

illustrated  in  Figure  10.  i 

i 

The  next  stage  of  this  structure  would  obviously 
contain  N x I,  nodes  where  N is  the  number  of  possible  \ i 

^ i ' 

states  S.  and  I,  is  the  number  of  nodes  at  stage  k.  Thus  j. 

X iC  I I 

the  number  of  nodes  expands  exponentially.  However,  in 
case  the  function  f^  depends  only  on  a finite  portion  of 
the  past  trajectory,  then  the  tree  structure  eventually 
becomes  a finite  trellis  at  the  stage  which  accounts  for 
the  definition  of  f^,  resulting  in  a trellis  appropriate 
for  Viterbi  decoding.  If  the  function  f^  has  infinite 
memory,  then  obviously  some  approximation  technique  must 
be  used  to  keep  the  number  of  nodes  finite.  One  such 
possible  approximation  is  to  save  only  a given  number  of 
nodes  at  each  stage,  most  likely  those  with  the  highest 
posterior  probability.  Another  scheme  which  is  possible 
is  to  save  only  enough  nodes  at  each  stage,  the  sum  of 
whose  posterior  probabilities  is  less  than  or  equal  to 
some  specified  number,  This  latter  method  is  attrac- 

tive from  the  standpoint  that  for  high  signal-to-noise 
ratios  the  number  of  nodes  saved  would  be  small,  while  for 
low  SNR,  the  number  saved  would  be  larger.  This  scheme 
therefore  would  have  the  attractive  feature  that  the 
processing  load  would  automatically  adapt  to  the  SNR. 


C.  ESTIMATOR  ALGORITHM 

The  following  algorithm  implements  the  estimator  given 
by  equations  (26)  and  (29)  . For  a practically  realizeible 
estimator,  some  rule  which  saves  only  a finite  number  of 
paths  as  discussed  above  must  be  used  at  step  8. 

Step  0 Initialization; 
k * 0 


1°  = MN  (number  of  joint  states) 

A°(i),  i = 1,2,...,I°,  arbitrarily  specified 


P®(i)  = 1/MN,  i = 1,2,...,I° 


Step  1 Obtain  indices  for  new  nodes 
a)  k = k + 1 


b)  For  q = 1,2, .. . I 


(k-1) 


m ~ 1,2,«««  M 


n = 1,2,...  N 


j = (q-1)  I + (m-DM  + n 


Step  2 Label  each  new  node: 
For  each  n,  m,  q,  obtain 


A^(j)  = f^(S^,A’''^(q)' 
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step  3 Obtain  transition  probabilities: 


For  each  n,  m,  q,  obtain 


PTR(m,  n,  q)  = PS  (S^l  0^,0^,  A^“^)  • PR (Uj^  | U^, 


Step  4 Calculate  for  each  hypothesized  transition 

(some  obvious  indices  are  omitted) 


For  each  n,  m,  q,  compute: 
a)  Kalman  step: 


^k-llk-l 


''k|k-l'3>  = 


=k<3>  * \|k-l<3>H''<V'«^k|k-l«’'  + 


==k|k-l<j'  “ ^k  - “‘®m>  yk|k-l<3) 


l^k|k<’»  ' yk|k-l<i>  * °k<l'^k|k-l'^> 


\|k«)  = <I-=k<j>“'V>\|k-l<3> 


V (i)  = H(S^)V,.,,.  , (j)H^  + R.  , 

^klk-1  ^ 
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step  8 Update  number  of  paths 


go  to  step  1, 


It  is  to  be  noted  that  the  computations  cannot  be 

carried  out  "in  place";  that  is,  A (j)  cannot  be  stored  in 

k-1  k 

the  same  locations  as  A (j)  until  all  the  A (j)  have  been 
computed.  Similarly,  the  Kalman  filter  means  and  variances 
must  be  stored  in  separate  temporary  locations  until  step  5 
is  completed. 

D.  DISCUSSION  AND  RELATION  TO  PREVIOUS  RESULTS 

In  the  language  of  the  literature  on  non-linear  filtering, 
the  present  result  represents  an  extension  of  previous 
results  in  system  identification  problems  to  the  case 
where  the  unknown  discrete  system  parameter  Sj^  is  the  result 
of  a probabilistic  mapping  of  an  underlying  memory-conditional 
Markov  process.  Previous  investigations  have  treated  both 
the  case  where  s^  is  a Markov  process  [10] , [11]  , and  the 
case  for  s^  an  unknown  time-invariant  parameter  [9] . The 

j 

present  result  reduces  to  these  results  for  the  appropriate  | 

modeling  of  s^,.  ] 

Case  I:  Markovian  Parameters  [10]  [11] 

In  this  case,  Sj^  is  a finite-state  discrete-  : ^ 

time  Markov  chain  with  transition  matrix  j 

A ; 

P (k)  } » {Pr[s,  = S.|s,  , = S.]}.  The  n-dimensional , ; 

13  K 1 K*  X 3 

-conditional  system  dynamics  are  given  by:  • 


82 


and  the  m-dimensional  measurements  are 


^ = «<\>yk  "k 

The  random  variables  Wj^,  n^^  are  zero-mean  independent 

gaussian,  and  independent  of  the  Markov  chain  Sj^. 

In  terms  of  the  generalized  model  developed  above,  the 

memory  function  f^  (13)  is  specified,  for  this  case,  by 

T 

= [s^  ®k-l  * ' ’ ®o^  output  state  mapping 

probabilities  (11)  are  independent  of  the  - process 
and  given  by  {pj^j(k)}.  The  system  dynamics  and  measure- 
ment equations,  in  terms  of  the  realization  of  the  Sj^  - 
process  are  then  given  by 


i'k  = ^<®k  Vi’^k-i  ''<=k  "k-i’^k 


^k  = “k-i'^k  * "k 


The  posterior  measurement-conditional  path  probabilities 
are  given  exactly  by  equation  (26) . The  likelihood  equations 
(29)  for  are  obtained  in  the  same  manner  by  replacing 
H(S.)  with  H(S.  A ) where  A is  a path  specification  obtained 

X X ^ ^ 

through  the  memory  function;  A = [sf^  ... 

The  posterior  probability  for  the  parameter  Sj^,  then  is  given 
by  summing  over  the  paths : 
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The  CME  or  MAP  estimate  may  then  be  obtained: 

N ■ , 

CME:  s.  = Z s.  P (S.  ) 

^ i=l  ^ ^ 

MAP:  s,  = S.:  P^(S.)  = max  P^(S.). 

^ D ^ i ^ 

Case  II:  Unknown  Time-invariant  Parameters  [9] 

For  this  case,  since  the  parameter  Sj^  does 
not  change,  the  memory  function  is  given  by  = s^,  with 
an  initial  probability  given  by  p?  = PrTs^  = , i = 1,2,  ...  N. 

The  dynamics  and  measurement  equations  are 


^k-i  "k-i 


^k  "k- 

Again  the  posterior  path  probabilities  for 
Sq  are  given  by  equation  (26) . The  likelihoods  are  determined 
from  equation  (29),  but  since  there  is  no  path  branching, 
the  Kalman  filters  all  operate  in  parallel,  each  on  a 
different  conditioning  S^. 
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Additionally,  since  the  parameter  transition  probabili 
ties  (k  ^ 1)  are  given  by  Pr[Sj^  = = S^]  = 6j^(i-j), 

the  sum  over  the  previous  paths,  nmq,  in  equation  (26) 
becomes  a single  term  for  each  path  extension,  and  (26) 
reduces  to 

i = 1,2  ...  N 

/ 

which  is  Lainiotis'  result  [9].  Note  that  since  there  is 
no  branching  of  the  paths,  the  exact  optimum  solution  for 
this  case  is  realizable. 


'®1>  ' -S 

j=l  J 3 


VI.  A PRACTICAL  HKM  MODEL 


While  the  results  of  the  preceding  theoretical  develop- 
ment show  how  optimum  estimation  of  the  state  of  the  HKM 
process  may  be  performed,  it  remains,  of  course,  to  specify 
the  parameters  of  the  model.  In  this  section,  specific 
values  for  the  model  parameters  are  derived  and  it  is  shown 
in  principle  how  increasingly  complex  models  may  be  obtained. 
While  the  specific  model  derived  in  this  section  is  one  which 
considers  the  letters  of  the  text  to  be  independent  and 
equally  likely,  it  is  shown  in  principle  how  this  model  may 
be  easily  extended  to  include  contextual  message  information 
as  well. 

The  parameters  to  be  determined  are  given  by  equations 

(9)  : 


that  is,  the  state  probability  transition  matrix  and  the 
recursive  memory  function.  These  expressions  are  given 
in  terms  of  the  components  of  Sj^,  u^,  by  equations  9a 
and  9b: 

Keystate  transition  matrix:  p(Xj^|aj^  u^^  ^k-1  “k-1^ 
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Morse  symbol  transition  matrix:  '^k-l  ^k-1  ^k-1^ 

Text  Letter  transition  matrix:  P^^k^^k-l 

Control  transition  matrix:  P^^i’^k-l  “k-1  ®k-l  ^k-1^ 

Keystate  memory  function:  ^g^^k'^k-l^ 

Morse  Encoder  memory  function:  ^a^^k'^^k-l^ 

TEXT  memory  function:  ^X^^'k'^k-1^ 

Thus  the  problem  is  to  determine  reasonable  values 
for  the  probability  assignments  (9a)  and  to  construct  the 
recursive  functions  (9b)  which  account  for  the  portion  of 
the  process  which  can  be  described  deterministically. 

A.  KEYSTATE  MODEL 

The  simplest  usable  model  of  the  evolution  of  the  keystate 
would  be  the  simple  Markov  model  described  by: 

P(Xj^|Xj^_^)  = Pr  [Xj^=j  |Xj^_^=i]  ; i,j  = 0,1 

This  model  suppresses  any  dependence  of  the  transition 
probability  on  current  and  past  Morse  symbols 
and  speed  of  transmission  (uj^)  , and  limits  the  dependence 
on  past  history  of  the  keystate  to  the  immediate  past, 

Such  a model  would  have  the  memory  function: 


8: 


The  four  Markov  transition  probabilities  Pr  [Xj^=l| 

Pr  [Xj^=l|  Xj^_j^=0]  , Pr  [Xj^=0|  Xj^_j^=0] , Pr  [Xj^=0|  Xj^_j^=l]  can  be 
obtained  empirically  by  determining  the  relative  frequency 
of  the  states  11,  10,  00,  01  in  a large  ensemble  of  actual 
hand-keyed  Morse  messages.  Clearly  these  probabilities 
are  dependent  on  the  sampling  rate.  As  a simple  example, 
consider  the  possible  realization  of  an  HKM  sequence  as 
illustrated  in  Figure  11,  with  the  resulting  transition 
probabilities  for  this  sequence  given  in  Table  VIII. 


Figure  11.  Example  Of  Sampled  HKM  Process 


TABLE  VIII 

Transition  Probabilities  For  Illustrative  HKM  Process 


State  No.  of  Relative 

Transition  Occurrences  Frequency 


Probability 

Estimate 


I 

i: 

I 


! 


^ 

■ I 

i! 

If  the  sample  rate  were  different  from  that  illustrated 
then  obviously  the  relative  frequency  of  each  of  the 

transitions  would  be  different;  this  dependence  on  S2unple  i 

rate  is  shown  in  Table  IX. 


TABLE  IX 

Transition  Probability  As  Function  Of  Sample  Rate 


Sanple  Rate 

State  Transitions 

(relative  to 
illustration) 

1/1 

1/0 

0/0 

0/1 

Freq 

Prob 

Freq  Prob 

Freq  Prob 

Freq  Prob 

IX 

30/33 

.91 

3/33  .09 

16/19  .84 

3/19  .16 

.5X 

13/16 

.81 

3/16  .19 

7/10  .7 

3/10  .3 

2X 

63/66 

.95 

3/66  .05 

35/38  .92 

3/38  .08 

This  artificially  induced  dependence  of  the  keystate 
transition  probability  on  sample  rate  is  undesirable  from  a 
modeling  viewpoint  since,  in  reality,  the  continuous-time 
HKM  process  generated  by  the  sending  operator  has  no  such 
dependence,  and  it  is  intuitively  unsatisfactory  to  require 
the  statistics  of  the  sending  operator  to  fit  an  arbitrarily 
selected  time  scale. 

This  dependence  can  be  removed  by  normalizing  the  time- 
scale  to  the  element-duration,  whereby  instead  of  measuring 
the  sample  rate  in  samples  per  second,  the  sample  rate  is 
measured  in  samples  per  duration  in  elements.  Consider, 


i I 
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then,  the  following  expressions  for  describing  the  keystate 
evolution : 


P<=‘kl“k  «k-l'  “ ''■^'Vjl“k'“i'6k-l“®n’ 


<'k  = ♦k-l'^-=‘k-’^-l-"2=‘k  =‘k-l>  ■"  1 


where  it  is  seen  that  the  recursion  for  (j)j^  counts  the  number 
of  samples  since  the  last  zero-one  or  one-zero  keystate 
transition.  This  description  then  conditions  the  keystate 
transition  probabilities  not  only  on  the  immediate  past 
keystate  also  on  the  data  rate  Uj^,  and  the  number 

of  samples,  (fj^,  that  the  key  has  been  in  a 1 or  0 state 
since  the  last  transition. 

Now  if  (J)j^  is  given  in  samples  with  a sampling  interval 
T,  then  Tj^  = is  the  eimount  of  time  (in  seconds)  since 

the  last  0 to  1 or  1 to  0 transition.  If  Uj^  is  given  in 
terms  of  words-per-minute,  then  the  element  duration  for 
this  rate  is  rj^  = (6/5)  x (1/uj^)  • Thus  the  normalized  time 
for  this  data  rate  is  given  by : 


* V-^k 


^♦k  “k  ^ 
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This  description  of  the  keystate  transition  probabilities 
is  clearly  more  satisfying  since  it  depends  only  on  the 
individual  sending  operator's  rate  of  transmission  and  keying 
characteristics,  and  not  on  the  sample  rate. 

The  model  is  still  not  complete,  however,  since  it  does 
not  allow  for  dependence  on  the  type  of  Morse  symbol  being 
keyed,  clearly  for  dots  and  element  spaces,  transitions 
between  mark  and  space  states  occur  more  frequently  than 
for  dashes,  character  spaces,  word  spaces,  and  pauses. 
Additionally,  these  transition  probabilities  depend  to  some 
extent  on  the  previously  keyed  symbols,  with  the  degree  of 
dependence  being  a function  of  the  type  of  key  used.  For 
mechanical  bugs,  a series  of  dots  separated  by  element 
spaces  is  sent  by  simply  holding  the  paddle  in  one  position. 


creating  a string  of  symbols  with  virtually  equal  durations. 

I When  sending  a dot/dash  combination,  however,  the  element 

, , space  duration  is  determined  by  the  operator's  dexterity  and 

not  by  a mechanical  device,  so  the  variability  of  this  ele- 
ment space  duration  is  higher  than  that  for  the  repeated  dot 
sequence.  A similar  effect  occurs  when  the  key  is  an  elec- 
tronic bug,  although  the  variability  of  repeated  symbols 
is  even  less  than  that  for  the  mechanical  bug.  The  same 
type  of  dependence  on  past  symbols  has  been  noted  even  for 
senders  using  a telegraph  key  [12]  [13].  It  has  been  found 
that  the  primary  effect  is  that  of  reduced  variability  of 
element-space  durations  when  the  proceeding  symbol  was  a 


f 
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dot  (a  detailed  analysis  of  the  effect  of  key  type  on 
keystate  statistics  may  be  found  in  [13]). 

While  the  keystate  transition  probabilities  have  been 
noted  to  be  dependent  on  the  preceeding  symbol  sequence, 
this  dependence  is  clearly  a second-order  effect  when  con- 
ditioned on  the  current  symbol.  In  the  model  developed 
here,  then,  these  second-order  effects  are  ignored  and  the 
final  expressions  for  the  keystate  transition  probability 
model  are  given  by: 


P^^kl^k  ^k  Vl^  = l^k=^'Vm'Vl=®n’ 


®k  = 


= Vl  ■ ""v  ~ "'v-l  + 2x^  X^_T  ) + 1 


k-1  ‘•"k  k-1' 


In  terms  of  the  normalized  time  scaled,  the  transition 
probabilities  are 

example,  the  probability  Pr  [Xj^=l  |xj^_j^=l,aj^=dot,rj^=r^,Tj^_^=  t] 
is  the  probability  that  at  time  k,  the  key  will  remain  in 
state  1,  given  that  the  operator  is  sending  a dot,  that  his 
average  element  duration  is  r^^,  and  that  they  key  has  been 
in  state  1 for  t element  durations.  Clearly  if  t is  close 
to  zero,  then  this  probability  is  nearly  1;  and  similarly 
if  t > 2,  then  the  probability  is  small. 

An  equivalent  expression  of  this  probability  is  the 
probability  that  the  duration  becomes  duration 


1 


I 


^2^ 


+ T/rj^  since  if  = 1,  then  T(})j^  = t + t = 

+ T.  This  probability  can  be  determined  from  the  den- 
sity of  symbol  durations,  conditioned  on  speed  rj^  and  symbol 
type. 

The  modeling  of  the  symbol  duration  densities  has  been 
a topic  of  considerable  interest  among  investigators  working 
on  the  Morse  decoding  problem.  In  the  past,  because  of  lack 
of  sufficient  empirical  data,  these  densities  have  been 
assumed  to  be  truncated  gaussian  or  uniform  [2]  [14].  A 
recent  intensive  modeling  investigation  by  Technology  Services 
Corporation  [13] , did  indeed  demonstrate  the  not  surprising 
result  that  when  normalized  for  speed  variation,  the  density 
of  each  symbol  duration,  averaged  over  several  operators, 
approaches  the  gaussian  density.  For  individual  operators, 
however,  the  densities  are  far  from  gaussian,  and  no  single 
normalizing  technique  was  found  which  would  allow  for  para- 
metric estimation  of  the  individual  densities.  Thus,  the 
problem  of  parameterizing  the  symbol  duration  densities  of 
individual  Morse  operators  remains  open.  Indeed,  the  evidence 
supported  by  the  data  accumulated  so  far  indicates  that 
estimation  of  these  highly  individualistic  densities  must  be 
accomplished  on-line  using  a combination  of  parametric  and 
non-parametric  techniques . 

It  is  not  the  purpose  of  the  present  research  to  delve, 
yet  again,  into  this  density  estimation  problem,  but  to  show, 
whatever,  the  proper  density,  how  it  can  be  used  most  effec- 
tively for  Morse  transcription.  For  the  purposes  of  the  HKM 


i 

•: 

j 


i 
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model  developed  here,  then,  a parametric  symbol  duration 
density  is  hypothesized  and  justified  on  the  basis  of  intui- 
tive arguments.  Traditionally,  the  local  speed  of  the  Morse 
signal  in  wpm  is  defined  as  1.2  times  the  reciprocal  of  the 
element  duration  (in  sec) , averaged  over  10-20  mark-space 
pairs.  A histogram  of  the  normalized  symbol  duration  (actual 
duration  in  seconds  divided  by  average  element  duration)  is 
then  taken  to  be  an  estimate  of  the  shape  of  the  density 
function  for  that  symbol.  The  new  approach  to  be  considered 
here  is  to  hypothesize  an  instantaneous  speed  of  transmission, 
defined  to  be  the  speed  at  which  a single  symbol  is  sent. 

The  ins tant aneous  element  duration  (baud)  is  likewise  defined 
on  an  individual  symbol  basis.  The  effect  produced  by 
assigning  appropriate  probability  densities  to  each  results 
in  the  same  description  for  an  average  10-20  mark-space  pair 
segment  as  does  the  traditional  approach.  The  reason  for 
hypothesizing  such  parameters  is  simply  because  it  is  more 
intuitively  satisfying  to  propose  the  existence  of  individual 
symbol  statistics  whose  average  behavior  duplicates  the 
observed  empirical  behavior,  rather  than  to  propose  that 
the  statistics  of  each  individual  symbol  are  identical  to 
the  observed  average  statistics.  Although  this  distinction 
is  a fine  point,  it  allows  greater  flexibility  in  estimating 
the  keystate  transition  probability  with  fewer  parameters. 

Consider  then  the  following  hypothesized  random 


variables ; 


r = instantaneous  speed  of  transmission 


A = instantantous  element  duration  (baud) 

and  let  dot  and  element-spaces  have  duration  = A;  dashes 

and  character  spaces  = 3A;  word-space  = 7A;  pause  = 14A. 

Then  in  terms  of  the  actual  symbol  duration,  d : 

m 

A d 

A A m 

A = ' 

m 

where  m = 1,  3,  7,  14  as  appropriate. 

The  normalized  symbol  duration,  in  terms  of  A and  r is 
given  by: 


♦a  = l|> 

Note  that  while  A is  well-defined  in  terms  of  a measurable 
quantity,  r is  arbitrary.  However,  it  is  convenient  to 
define  r such  that  its  value  is  indicative  of  the  actual 
speed: 


r 4 (^) 
mean  ' 5 ^ A 

Although  this  expression  determines  the  statistical  behavior 

of  r through  its  dependence  on  the  random  variable  A, 

mean 

clearly  it  does  not  restrict  the  freedom  to  assign  appropriate 
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statistical  description  to  the  other  moments  of  the  random 
variable  r,  independent  of  the  statistics  of  A. 


Consider  now  the  random  variable  (ji^,  and  note  that  m<|i^ 
is  the  normalized  symbol  duration  (in  elements) , given  that 
the  symbol  was  transmitted  at  rate  r.  A density  for  m<|>^, 
conditioned  on  r,  then  describes  the  keystate  duration 
random  variable,  normalized  for  speed.  Let  this  random 
variable  be  described  by  the  Laplacian  density  (double-sided 
exponential)  with  mode  m and  parameter  a,  as  illustrated  in 
Figure  12,  below. 


p(m(|>./r) 


Lj_. 


In  terms  of  the  speed  r: 


a (5/6  mAr  - m) 


! n»<(i^  £ m 


p(m4)^/r)  = 


„^a(m  - 5/6  mAr)  _ 

ce  ; m4)^  ^ m 


The  parameter  a and  coefficient  c are  to  be  chosen  such  that 
Pr[l(J)^  ^ 2]  = Pr[3<t)^  £ 2]  = .0135;  that  is,  the  probability 
of  error  in  sending  a dot  for  a dash  or  an  element  space 
for  a character  space  (and  vice  versa)  is  arbitrarily 
selected  to  be  1.35%.  This  symbol  error  rate  was  found  to 
be  the  average  error  using  optimum  separation  thresholds  for 
55  samples  of  hand-keyed  Morse  studied  in  the  TSC  analysis 
[13] ; and  since  the  densities  are  conditioned  on  the  instan- 
taneous speed,  the  normalized  optimum  threshold  is  halfway 
between  m = 1 and  m = 3.  On  this  basis,  then,  a and  c are 
determined  as  follows: 


Pr(l<|>^  > 2] 


j pC  I<|)/r)  d(|)^ 
2 00 

f ad-^,) 

I ce  d 


Likewise: 


= c/a  e 


; 


c/a  + c/a  = 1 

c = a/2 

Solving  for  a,  c gives,  for  dots,  dashes,  element  spaces, 
character  spaces: 

a = 3.61 

c = 1.81 

Using  the  saune  procedure  for  word  space  (m=7)  and  pause 
(m=14) , the  values  for  the  densities  are: 

word  spaces:  a = 1.81,  c = .90 
pause:  a = .90,  c = .45 
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Having  constructed  the  duration  densities,  the  speed- 
conditioned  keystate  transition  probabilities  can  now  be 
determined . 

Let  be  the  current  normalized  keystate  duration, 
i.e.,  the  amount  of  time  (in  terms  of  instantaneous  element 
duration)  since  the  last  0 to  1 or  1 to  0 transition.  Then 
the  required  probabilities  are  Prl(j)^  ^ °o  ^^^k-l'^k'^k' — °o^ 
where  e is  the  normalized  sampling  interval  given  by 
e * t/A.  It  is  seen  that  this  expression  gives  the  transition 
probeUailities  in  terms  of  the  probability  of  extending  dura- 
tion for  one  more  sample  interval.  The  conditioning 
parameters  provide  the  normalization  coefficients  to  be  used 
for  p(m(J)^/r).  Given  the  appropriately  scaled  density  then. 


i i °o>  * 


but  e > 0,  so  D^+e  > D^#  and  the  joint  probability  becomes 


Pr((f^  1 - °o^  ^ ' 


and  so  the  conditional  probability  is  given  by: 


Pr(*^  > > D^l 


Pr[(|>^  > D|j+e1 

i “o' 


where  ^ ^o^  ' computed  as  follows: 
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Pr[<^^>DQ+el  = J p(4i^) 


D +e 
o 


. -a(D  +e-m) 
o 


; D +e  > m 
' o — 


, a (D  +e-m) 

^ 1 - ^ ° 1 I" 


Similarly; 


0( 

/ 


. -a(D  -m) 
l_  o 


; > m 


, a(D  -m) 

1 - ^ ? °o  ~ 


Forming  the  quotient  of  these  probabilities  in  the  appro- 
priate ranges  gives; 


-a  «- 


, > m 


^ atD^+e-m) 
l-^e 


D < m 
o — 


Prtd)*  > D +e/<J>.  > D^]  = 


A - '"o' '""A  - ‘'o'  'j  fe 


, -a(D  -m) 

l_  o 


D^+G  > 
O — 


, a(D^+e-m) 

1-^  ° 


; __  i ' 


m 


D +e  < m 


The  above  expression  then  represents  the  keystate  transition 
probability  for  the  "transitions"  1-1  and  0-0,  conditional 
on  the  current  symbol  type,  data  rate,  and  length  of  time 
already  in  state  1 or  0.  The  probabilities  for  the  transi- 
tions 1-0  and  0-1  are  found,  obviously,  by  subtracting  from 
1. 

B.  SPEED  TRANSITION  MODEL 

The  random  control  vector  u^  may  contain  components 
which  model  operator  sending  peculiarities  such  as  random 
insertions  of  extra  dots,  slurs,  character  splitting,  or 
any  other  feature  of  interest  which  controls  the  manner  in 
which  encoding  takes  place;  it  is  not  limited  to  speed  con- 
trol alone.  However,  the  peculiarities  mentioned  above 
are  highly  individualistic  and  little  modeling  of  these 
peculiarities  has  been  done.  It  is  conjectured  that  such 
modeling  will  have  the  same  fate  as  that  of  attempting  to 
obtain  a general  parametric  model  of  the  keystate  duration 
densities;  that  is,  no  general  model  will  be  found,  and 
such  modeling  will  require  on-line  estimation  techniques. 

For  the  purposes  of  the  HKM  model  developed  here,  these 
peculiarities  are  ignored,  and  the  only  component  of  the 
control  vector  Uj^  considered  is  the  instantaneous  speed  r. 

The  speed  transition  probabilities  are  developed  on 
an  intuitive  basis  seasoned  with  experience  and  the  results 
of  the  TSC  study  on  observed  hand-sent  code  speed  variability. 
In  that  study  it  was  found  that,  on  the  average,  hand-sent 


code  exhibits  a speed  difference  of  about  2.5  wpm  between 
segments  of  10  mark-space  pairs,  but  that  it  is  not  uncommon 
to  observe  a speed  difference  of  8-10  wpm  between  segments. 

Now  observing  that  the  speed  transition  probability  expression 
of  the  HKM  model,  ‘^k-1  ^k-1  ^k-1^  ' allows  for 

conditioning  on  the  entire  past  history  of  the  state  of  the 
HKM  process,  it  can  be  seen  that  this  transition  probability 
may  take  into  account  such  items  as  message  duration  (for 
modeling  the  effect  of  operator  fatigue) , the  actual  text 
itself  (for  modeling  the  effect  of  speed  changes  due  to 
sending  different  types  of  text  material) , or  any  other 
feature  which  may  have  an  effect  on  sending  speed.  The  only 
conditioning  to  be  considered  here,  however,  is  the  immediate 
past  speed  the  past  history  of  the  encoded  output, 

and  the  keystate  duration  Let 

e {i;  10  £ i ^ 60,  i an  integer};  that  is,  a set  of 
discrete  speeds  in  wpm  between  10  and  60  wpm.  The  following 
model  for  P ) is  proposed: 

If  0 (no  change  in  keystate)  , then 

P^^kl'^k-l  “k-1  ^k-1^  “ ^^^^k  ^ ^i'^k-1  ^ '‘^k-l' ^k-1  ^ 

if  i / j. 

if  i = j . 
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That  is,  the  speed  is  not  allowed  to  change  except  when  the  I 

keystate  changes  from  0 to  1 or  1 to  0,  no  matter  what  the  j 

previous  symbol  is.  For  = 0,  the  speed  transition  j 

probabilities  are  made  conditional  on  the  type  of  Morse  | 

symbol  just  completed:  | 

For  indicates  dot,  dash,  e-sp:  | 

I 

1 

Pr[u^  = Rj  t 2i.lu^  - = 01  = 

where  i = 0,  1,  2. 

This  assignment  of  tansition  probabilities  allows  the 
speed  to  change  by  increments  of  0,  ±2,  ±4  wpm  according 
to  the  probability 

For  cijj  1 indicates  c-sp,  then  the  increment  remains 
the  same,  but  the  transition  probability  assignments  may 
be  different. 

For  a,.-!  indicates  word-sp,  the  increment  is  increased 
to  5,  and  for  indicates  pause,  the  increment  is  10. 

To  complete  the  model,  the  remain  to  be  selected. 

These  probabilities,  which  were  selected  on  the  basis  of 
speed  differences  reported  by  TSC  (and  on  intuitive  appeal) , 
are  given  in  Table  X. 

Note  that  the  absolute  average  speed  differences  for 
the  four  categories  correspond  roughly  to  the  ranges  observed 
by  TSC. 

'i 
] 

) 
i 
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C.  MORSE  SYMBOL  TRANSITION  MODEL 
i 

The  symbol  transition  probabilities,  conditional  on  the 
letter  being  sent,  are  obviously  either  zero  or  1,  since 
I knowing  the  letter  specifies  the  code  sequence.  If  the 

j model  is  only  a first  or  second-order  Markov  model,  then  the 

symbol  transition  probabilities  for  various  types  of  text 
may  be  computed.  Since  it  is  desired  to  test  the  performance 
of  the  estimator  as  a function  of  modeling  complexity,  these 
probabilities  were  estimated  for  both  a first  and  second 
order  model  and  are  given  in  Tables  XI  and  XII,  respectively. 
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TABLE  XI 

First-Order  Markov  Symbol  Transition  Matrix 


• 

— 

W 

f • 

" 0 

0 

.58 

.33 

.07 

.02 

- 

0 

0 

.54 

.37 

.07 

.02 

.55 

.45 

0 

0 

0 

0 

•v. 

.5 

.5 

0 

0 

0 

0 

w 

.5 

.5 

0 

0 

0 

0 

, p 

.5 

.5 

0 

0 

0 

0 

1 

TABLE  XII 

Second-Order  Markov  Symbol  Transition  Matrix 


• 

w 

S *-1 

• ^ 

.55 

.45 

0 

0 

0 

. a. 

.5 

.45 

0 

0 

0 

0 ' 

.w 

.5 

.5 

0 

0 

0 

0 

•P 

.5 

.5 

0 

0 

0 

0 

.55 

.5 

0 

0 

0 

0 

-'Xj 

.5 

.45 

0 

0 

0 

0 

-w 

.5 

.5 

0 

0 

0 

0 

-p 

.5 

.5 

0 

0 

0 

0 

/\  • 

0 

.5 

.581 

.335 

.069 

.015 

0 

0 

.54 

.376 

.069 

.015 

%. 

0 

0 

.923 

.062 

.012 

.003 

%- 

0 

0 

.923 

.062 

.012 

.003 

w. 

0 

0 

.923 

.062 

.012 

.003 

w- 

0 

0 

.923 

.062 

.012 

.003 

p* 

0 

0 

.95 

.04 

.009 

.001 

p- 

0 

0 

.95 

.04 

.009 

.001 

— 

IL. 
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The  encoder  memory  function,  f^,  may  be  constructed  to 
record  the  previous  symbol  for  the  first-order  model,  or 
the  previous  two  symbols  in  the  second-order  case.  In  case 
the  symbol  transition  probability  is  made  conditional  on 
the  letter  being  sent,  there  is  no  need  to  record  previous 
symbols  for  use  by  the  encoder.  As  a minimum,  however,  the 
function  f^  must  record  the  previous  symbol  for  use  by  the 
speed  transition  probability,  since  it  has  been  made 
conditional  on  this  symbol. 

D.  TEXT  LETTER  TRANSITION  MODEL 

For  equally  likely  independent  letters , the  letter 
transition  probabilities  are  uniform,  and  the  only  con- 
ditioning necessary  is  on  so  that  when  indicates 

the  end  of  a letter,  the  letter  transition  is  allowed  to 
occur.  During  the  period  when  does  not  contain  a 

c-sp,  w-sp,  or  pause,  obviously  the  letter  transition 
probability  is  zero.  This  case  of  equally  likely  letters 
is  the  highest  complexity  modeling  actually  coded  and  tested 
in  this  investigation.  It  is  clear  from  the  theoretical 
error-rate  analysis  of  section  III,  however,  that  the 
largest  payoff  in  terms  of  increase  performance  is  to  be 
found  in  more  sophisticated  models  for  this  transition 
probability  and  memory  function.  This  fact  was  recognized 
early  by  Gold  [12]  in  his  study  of  the  Morse  decoding  problem, 
in  which  he  developed  the  MAUDE  algorithm  for  decoding  of 
the  demodulated  Morse  waveform:  "The  conclusion  is  inescapable. 


therefore,  that  for  the  automatic  reception  of  a language 
encoded  by  even  a simple  process  like  Morse  code,  a machine 
must  have  some  knowledge  of  the  language  if  it  is  to 
approximate  the  performance  of  a man." 

The  major  difficulty,  however,  in  modeling  the  message 
text  is  that  the  type  of  text  is  not  constant.  The  letter 
dependencies  are  highly  variable  among  such  traffic  types 
as  call-up,  response,  chatter,  formatted  messages,  plain 
language  messages,  code  groups,  etc.  Here  again,  then, 
it  is  conjectured  that  the  only  real  solution  is  to  perform 
on-line  modeling  of  this  transition  probability  and  memory 
function.  Clearly  a straightforward  application  of  proba- 
bility estimation  techniques,  while  feasible,  is  simply 
not  practical  in  this  case.  For  a third-order  model,  the 

4 

storage  requirements  would  be  on  order  of  36  = 1,679,616 

words,  just  to  store  the  transition  probability  matrix. 

The  f^  function  would  require  36^  locations  to  keep  track 
of  the  three  prior  letters.  Although  some  reduction  in 
memory  could  be  accomplished  since  some  letter  combination 
rarely  occur,  it  is  evident  that  the  storage  requirement 
is  large.  The  most  promising  technique  for  utilizing  the 
decrease  in  source  entropy  may  be  one  similar  to  that  for 
recognition  of  speech  using  a linguistic  statistical  decoder 
[15] , with  appropriately  modeled  linguistic  elements  and 
using  an  appropriate  channel  model  [16] . If  a suitably 
flexible  grammar  for  a set  of  Morse  messages  can  be  defined 


then  perhaps  a form  of  syntactic  decoding  is  in  order  [17] . 
If  the  semantics  of  the  message  are  well-understood  then 
one  possible  approach  is  to  use  a dictionary  look-up  to 


form  the  f^  function,  on  a word  basis.  This  technique  for 
English  text  messages  is  under  investigation  by  an  ARPA- 
funded  MIT  project,  but  a final  report  of  the  results  has 
not  yet  been  issued.  The  Army  Research  and  Development 
Agency  is  currently  studying  the  possibility  of  defining  a 
grammar  for  a specified  set  of  Morse  messages  for  use  in 
syntactic  decoding.  These  kinds  of  techniques  for  dynaunic 
on-line  construction  of  the  function  and  estimation  of 
the  transition  probabilities  are  clearly  the  only  realistic 
methods  of  reducing  the  entropy  of  the  text  sufficiently 
to  obtain  error  rates  comparable  to  that  of  the  human 
operator,  in  any  situation  except  for  random  letter  groups. 


108 


VII.  A PRACTICAL  HKM  CHANNEL  MODEL 

The  general  baseband  HKM  channel  model  developed  in 
Section  iv  is  given  by  the  channel  and  observation 


equations  (10) : 

= Y F(Sj^  '^k-i^  ^k-l  ^k-1^  "k 

Zk  = H(®k^  ^k  ^k 

where  Zj^  is  the  sampled  output  of  the  detector.  The  specific 
model  to  be  considered  here  requires  the  parameter  y and 
functions  F,  r,  H,  to  be  selected  such  that  the  resulting 
model  has  the  following  features ; 

(1)  The  noise  process  represented  by  nj^  is  a zero-mean 
white  gaussian  process,  with  known  variance  R^. 

(2)  The  amplitude  yj^  is  observed  only  when  Xj^  = 1, 
that  is,  during  the  signal  on-time  (MARK) , so 
that  H(Sj^)  = H(Xj^)  = Xj^. 

(3)  During  a MARK,  the  fading  amplitude  process  obeys 
a linear  gauss  Markov  process  given  by; 

j'k  ” ^ * ''k 

where  the  parameter  y and  the  variance  of  Vj^  are 
selected  to  represent  the  fading  observed  at  the 
detector  output. 
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(4) 


■j  I II*- 


The  observed  effective  transmitted  amplitude  is  a 
random  variable  which  obeys  the  following  time- 
varying  linear  gauss-Markov  process : 

yjc  = '''=‘k  ^ ''<*k  ^k  ^k-l’^k 

where  F and  F are  selected  such  that: 

(a)  During  a MARK  the  transmitted  amplitude 
remains  constant. 

(b)  During  a space  the  amplitude  can  change,  the 
amount  of  change  being  dependent  on  the  type 
and  duration  of  the  space. 

(5)  It  is  assumed  that  the  detected  signal  has  been 

gain- leveled  by  an  AGC,  so  that  the  average  detected 
output  power  is  normalized. 

The  parameter  selection  and  function  construction  process 
for  each  of  these  features  is  discussed  below. 

A.  THE  OBSERVED  NOISE  PROCESS 

Since  the  noise  process  observed  at  the  output  of  the 
detector  is  the  result  of  envelope  detection  of  a narrowband 
gaussian  process,  the  resulting  process  is  neither  zero-mean, 
gaussian,  nor  white.  The  sampled  process,  however,  has 
independent  noise  values  if  the  saunple  interval  t satisfies 
T ^ 1/2  Bgpp,  where  B^pp  is  the  bandwidth  (in  Hz)  of  the 
band-pass  filter  preceding  the  envelope  detector,  provided 
that  also  the  bandwidth  of  the  low-pass  filter  of  the  envelope 
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detector  is  greater  than  If  t is  less  than  this 

value,  then  the  sampled  noise  is  correlated,  and  a model 
which  accounts  for  this  correlation  would  theoretically 
provide  for  better  estimation.  Several  techniques  are 
available  for  such  modeling,  [18 ] and  should  be  used  if 
the  noise  is  correlated.  Clearly  if  t is  selected  purely 
on  this  basis  alone,  then  the  assumption  on  independence 
can  be  satisfied.  There  may  be,  however,  other  competing 
constraints  on  the  selection  of  x , and  although  the  value 
selected  may  render  the  independent  noise  assumption  invalid, 
its  effect  can  be  minimized  by  selecting  it  as  large  as 
possible  within  the  other  constraints. 

The  bandwidth  of  the  bandpass  filter  is  selected  on  the 
basis  of  the  largest  signal  bandwidth  expected.  The  highest 
code-speed  under  consideration  for  this  processor  design 
was  selected  to  be  50  wpm,  which  has  a minimum  pulse  duration 
(MARK)  of  24  msec.  The  specific  filter  implementation  was 
selected  to  be  a cascade  of  two  single-tuned  resonators, 
since  this  combination  has  a respectable  ratio  of  noise- 
bandwidth  to  3-dB  bandwidth  of  1.22  [19],  and  can  be  coded 
with  relatively  few  multiplication  per  sample.  For  this 
filter  implementation  the  optimum  bandwidth  as  given  by 
Skolnik  [19]  is  .613/. 024  = 25  Hz,  and  has  only  .56  dB 
of  loss  in  SNR  compared  to  the  matched  filter.  Although 
such  a narrow  bandwidth  greatly  increases  the  SNR  of  a 
signal  in  a 4 kHz  receiver  bandwidth  and  effectively  eliminates 


L_ ^ 


most  interferers,  it  is  clearly  too  narrow  to  accept  signals 
which  have  a significant  carrier  instability  due  to  chirp 
or  drift.  Since  it  is  not  uncommon  to  observe  carriers 
with  a chirp  on  the  order  of  50  or  so  Hz,  the  bandwidth 
required  is  on  the  order  of  100  Hz.  There  is  obviously  a 
strong  motivation,  therefore,  to  investigate  filtering 
techniques  which  would  adapt  to  the  chirp,  since  a 100  Hz 
wide  filter  represents  a loss  of  6 dB  compared  to  the 
optimum  bandwidth  of  25  Hz.  Motivation  for  adaptive 
filtering  techniques  is  also  provided  by  the  fact  that  at 
20  wpm  the  optimum  bandwidth  is  only  .613/. 060  = 10  Hz, 
thus  there  is  a 10  dB  loss  in  SNR  compared  to  the  optimum 
bandwidth  when  using  a 100  Hz  filter. 

For  this  investigation,  since  the  primary  emphasis  is 
on  optimum  demodulation  and  decoding  techniques , a fixed 
100  Hz  band-pass  filter  is  used.  For  this  bandwidth,  then, 
the  sample  rate  may  be  selected  to  be  200  Hz,  with  a resulting 
sample  interval  of  5 msec.  Since  this  quantization  is  con- 
sidered adequate  for  representing  the  minimvun  duration  24  msec- 
long  pulse  of  the  50  wpm  code  with  sufficient  precision, 
then  T is  selected  to  be  5 msec. , resulting  in  independent 
noise  samples. 

Since  approximately  5 msec,  is  the  largest  quantization 
allowable  for  adequate  precision  in  representation  of  the 
code  symbols,  and  since  adaptive  techniques  for  the  band- 
pass filter  would  result  in  narrower  bandwidths , the  assumption 
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on  independent  noise  samples  would  be  violated  for  this 
case«  requiring  a model  which  accounts  for  correlated 
noise,  if  optimum  techniques  are  to  be  pursued. 

Although  the  zero-mean  assumption  on  the  output  noise 
process  is  violated,  a zero-mean  process  may  be  approximated 
by  estimation  of  the  mean  and  subtraction  of  it  from  the 
detected  output.  Estimation  of  this  mean  value  also  pro- 
vides an  estimate  of  the  noise  variance,  which  has  been 
assumed  to  be  a known  value  throughout.  (Again,  although 
techniques  are  available  for  modeling  in  the  case  of  unknown 
noise  intensity,  the  simplified  approach  taken  here  is  to 
use  the  estimate  of  Rj^  as  if  it  were  the  true  value.  It  can 
be  seen  in  section  IX,  Table  XIII,  that  the  resulting  pro- 

/\  A 

cessor  is  relatively  insensitive  to  R^,  as  long  as  R^^  is 
within  a rather  large  range  of  the  true  value.)  Estimation 
of  the  mean  noise  level  relies  on  the  following  relationships. 


Let  X^  be  a white  gaussian  random  process  with  one-sided 


density  N^,  input  to  the  BPF;  let  be  the  output  of  the 


envelope  detector,  with  Bj^pp  illustrated  below: 


Figure  13.  Envelope  Detection  Process 
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Then,  from  Davenport  [20] / 


“n  - = “o  ®BPF 


"n  ^ > 2(>*oW^ 


Thus  if  can  be  estimated  in  the  absence  of  a MARK,  then 


A ^ O 


and  the  approximation  to  a zero-mean  process  is 
Implementation  of  such  an  estimator  is  described  in 
Section  VIII. 

The  assumption  of  a gaussian  process  for  nj^  is  clearly 
violated  since  the  output  of  the  detector  has  a Rayleigh 
density  in  the  absence  of  a MARK,  and  a Rician  density  when 
signal  is  present.  Thus  not  only  are  the  statistics  not 
gaussian,  but  also  they  are  correlated  with  the  signal  when 
a MARK  is  present.  By  choosing  to  ignore  the  higher-order 
moments  of  the  density  (greater  than  2) , the  resulting 
estimator  based  on  this  assumption  may  not  be  optimal  in 
the  sense  of  providing  as  good  a conditional-mean  estimate 
as  possible,  but  it  will  still  provide  the  minimum-mean- squared- 
error  estimate. 
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During  the  period  when  Xj^  = 0,  the  transmitter  is 
turned  off  and  it  is  not  possible  to  observe  the  amplitude 
which  is  being  used  to  transmit  the  MARKS.  Thus  only 


noise  is  observed  during  this  period,  and  by  ignoring 
the  correlation  between  signal  and  noise  when  signal  is 
present,  the  measurement  equation  is  simply; 


= "'k  ^k  "k 


C.  FADING  MODEL 

The  effect  of  fading  can  be  observed  during  a MARK 
period,  with  the  maximum  fade  rate  being  determined  by  the 
band-pass  filter/dectector  bandwidth,  under  worst-case  HF 
channel  conditions  (rapid,  intense  fading) . For  typical 
values  of  fading  rate  on  the  order  of  1 Hz,  the  fading 
parameter  y,  for  a 5 msec  sampling  interval  is  given  by; 

^ = g-(.005)  (2Tr)  (1)  ^ 

The  intensity  observed  at  the  output  of  the  gain-controlled 
detector  can  be  approximated  for  the  typical  1 Hz  fade  rate 
by  noting  that  during  a 1 sec  fade  period  the  amplitude 
can  change  by  about  3 dB  for  a typical  receiver  AGO  circuit. 
The  intensity  for  this  range  of  change,  i.e.,  the  variance 
of  Vj^  is  about; 


r 

3 


1 
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Var  (Vj^)  = [2/(1./. 005)]^  = [2/200]^  = .0001. 


As  discussed  earlier,  in  Section  IV. B,  when  no  signal 
is  present,  the  effect  of  fading  is  that  the  subsequent  MARK 
appears  at  an  amplitude  which  differs  from  the  amplitude 
of  the  previous  MARK-  in  such  a way  that  it  appears  as  if 
the  MARKS  of  the  signal  were  transmitted  at  a random 
amplitude.  Because  of  this  effect,  these  mark-to-mark 
variations  are  lumped  together  with  the  variations  caused 
by  an  actual  change  in  transmitted  power. 


D.  APPARENT  TRANSMITTER  POWER  VARIATIONS 

In  addition  to  the  Mark-to-Mark  amplitude  variations 
discussed  above,  the  actual  transmitted  power  may  vary. 

Usually  this  effect  is  most  prominent  when  working  with  a 
communications  net,  since  the  received  power  of  each  of  the 
transmitters  on  the  net  will  usually  be  different.  These 
changes  usually  occur  after  a pause  (during  which  one  net 
member  has  signed  off  and  another  is  preparing  to  sign  on) ; 
however,,  it  is  not  uncommon  for  a new  net  member  to  sign 
on  during  a time  duration  for  a word  space  or  even  a character 
space,  especially  if  net  discipline  is  good.  It  is  assiamed 
that  changes  do  not  occur  during  an  element-space  or  a mark. 
The  following  model  accounts  for  these  effects: 


a)  For  a. 


mark: 


= Var(vj^)  » .0001 
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“‘k-l  ^k-l^  = Y = .97 

b)  For  element  space;  Xj^  = 0; 

0^  . 0. 

YF(-)  = 1. 

c)  For  element  space;  Xj^  = 1; 

Qw  = -O" 

YF ( • ) = 1. 

d)  For  ■*■  any  other  space;  Xj^  = 0: 

Ow  - “• 

yPC)  » .98 

e)  For  -*•  any  other  space;  Xj^  = 1; 

Ow  = -25 

YF  (•  ) = 1. 
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Part  (a)  is  just  the  fading  model  for  Marks  discussed 
above.  Part  (b)  expresses  the  statement  that  no  change  in 
amplitude  may  occur  during  an  element  space.  Part  (c) 
states  that,  at  the  end  of  an  element  space  the  transmitted 
amplitude  has  not  changed,  but  a variance  of  .01  is  asso- 
ciated with  the  amplitude  observed  on  this  transition.  The 
value  . 01  is  obtained  by  considering  that  at  the  end  of  an 
element  space  transmitted  at  50  wpm,  the  fade  may  have 

4 

decreased  the  eimplitude  to  (.97)  = .89  of  its  previous 

2 ~ 

value,  thus  a variance  of  (1  - .89)  = .01  is  appropriate. 

Part  (d)  states  that  for  any  other  space,  while  the  variance 

associated  with  the  transmitted  amplitude  is  zero,  the 

cunplitude  is  assumed  to  decrease  exponentially  with  time 

at  the  rate  (.98);  and  Part  (e)  allows  a subsequent  MARK 

to  appear  with  amplitude  determined  by  a gaussian  random 

variable  of  variance  .25.  (The  construction  of  the  r(*) 

function  is  implied  by  the  assignment  of  variances  to  the 

various  Q . ) 

w 
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VIII.  IMPLEMENTATION  OP  HKM  STATE  ESTIMATION  ALGORITHM 


The  implementation  of  the  estimator  algorithm  (Eqn.  26, 

30)  for  the  signal  and  channel  models  just  described  is  now 
presented.  In  the  context  of  this  model,  estimation  of  the 
keystate  is  referred  to  as  demodulation , estimation  of  the 
Morse  symbol  is  termed  decoding , and  estimation  of  the  text 
letter  is  called  translation.  The  estimation  algorithm 
performs  joint  demodulation,  decoding  and  translation,  i.e., 
these  estimates  are  not  made  in  a serial  fashion;  rather 
the  structure  of  the  code  is  used  in  an  optimal  way  to  aid 
in  demodulation,  and  the  structure  of  the  text  is  used  to 
aid  in  decoding.  From  this  viewpoint  the  algorithm  repre- 
sents a "correlator-estimator”  [21]  technique  in  which  a 
sequence  of  all  possible  keystate  transitions  are  hypothe- 
sized and  correlated  with  the  incoming  signal,  and  the  most 
likely  sequence  is  output  as  the  best  estimate.  From  the 
viewpoint  of  coding  theory,  the  algorithm  represents  a 
tree  decoder  in  which  all  possible  paths  of  the  joint  state 
evolution  of  the  process  are  examined  and  extended  in  an 
optimal  way.  If  the  memory  function  were  dependent  on  only 
a finite  portion  of  the  past  history  of  the  process  (usually 
a good  approximation)  then  the  tree  decoder  reduces  to  the 
Viterbi  decoder.  As  implemented  herein,  the  decoder  is 
most  like  the  M-Path  algorithm  described  by  Haccoun  .[22J  , with 


the  path  metric  being  the  product  of  the  likelihood  of  the 
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received  signal  along  the  path  and  the  transition  proba- 
bility for  the  path  extension.  If  the  decoder  is  constrained 
to  save  only  one  path,  then  the  decision-directed  optimal 
linear  filter  investigated  in  [2]  is  obtained. 

Proceeding  now  to  a detailed  description,  the  algorithm 
is  presented  in  terms  of  the  Fortran  code  used  to  implement 
it.  Subroutine  PROCES  is  the  main  calling  routine  which 
takes  an  input  signal  sample  each  5 msec,  along  with  an 
estimate  of  the  noise  power,  and  calls  the  appropriate  rou- 
tines in  order.  The  first  routine  called  for  each  sample 
point  is  TRPROB,  which  computes,  for  each  previously  saved 
path  ending  at  node  J,  the  probability  of  extending  the 
path  to  new  nodes  which  are  labeled  to  indicate  the  joint 
state  (keystate,  element  state,  letter  state,  data  rate). 

These  probabilities  are  computed  using  the  model  and  equa- 
tions described  in  the  previous  section.  Next,  subroutine 
PATH  labels  the  new  path  extended  to  each  new  node  with: 

(1)  the  number  of  samples  since  the  previous  keystate 
transition  along  that  path;  (2)  the  data  rate  of  the  new 
node;  (3)  the  identity  of  the  element  state  at  the  new 
node;  (4)  the  identity  of  the  letter  state  at  the  new  node. 
These  labels  are  obtained  from  the  memory  function  f^  with 
arguments  provided  by  the  identity  of  the  path  being  extended 
and  the  identity  of  the  new  node  to  which  the  path  is  being 
extended.  Subroutine  LIKHD  is  then  called  to  compute  the 
likelihood  of  the  input  signal  sample  for  each  transition 
under  the  hypothesis  that  that  particular  transition  occurred. 
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j LIKHD  maintains  an  array  of  Kalman  filters  for  computing 

r this  likelihood  as  given  in  Section  V.A  by  equation  (30) , 

and  using  the  specific  channel  model  described  in  the  previous 
section. 

Having  obtained  the  new  path  identities,  transition 
probabilities,  and  likelihoods,  the  posterior  probability 
of  each  new  node  (i.e.,  each  path  extension)  is  computed 
I using  equation  (26),  in  svibroutine  PROBP.  Next,  routine 

SPROB  computes  the  posterior  probability  of  each  keystate 
(0,1)  and  each  element  state,  and  the  conditional  mean 
estimates  of  the  data  rate,  by  summing  over  the  appropriate 
nodes.  The  MAP  estimate  of  the  keystate  at  this  point  is 
the  demodulated  signal,  and  the  conditional  mean  estimate 
of  the  keystate  is  the  (non-linear)  filtered  version  of 
the  detected  signal.  Also  the  evolution  of  the  MAP  esti- 
I mator  for  the  element  state  may  be  observed  at  this  point, 

j and  represents  the  decoded  message  with  zero  decoder  delay. 

The  next  function  to  be  accomplished  is  the  saving  of 
paths  for  the  next  iteration.  It  is  at  this  point  that  the 
estimation  algorithm  becomes  sub-optimal,  since  it  is 
clearly  not  possible  to  save  all  paths  at  each  stage  of 
iteration.  A technique  which  yields  a high  probability 
that  the  correct  path  will  always  be  saved  obviously  pro- 
vides the  best  sub-optimal  performance.  Several  techniques 
for  selecting  the  paths  to  save  are  available.  The 
. simplest  idea  is  to  always  save  a fixed  number,  say 
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^max'  determined  empirically,  however,  that,  while 

this  technique  does  indeed  give  a high  probability  of 
saving  the  correct  path,  most  of  the  time  the  posterior 
probabilities  of  many  of  the  saved  paths  were  very  low  and 
need  not  be  extended  at  all.  At  the  instant  of  a keystate 
transition,  however,  the  probabilities  become  more  uniform 
and  it  is  necessary  to  save  all  the  M paths.  The  next 
technique  then  was  to  save  only  enough  paths  such  that  the 
total  probability  saved  was  equal  to  subject  to  the 

constraint  that  M is  not  exceeded.  Another  technique 
suggested  by  [22]  is  to  make  the  number  of  paths  saved  a 
function  of  the  probability  of  the  highest  probability  path, 
such  that  when  the  highest  probability  path  has  a very  high 
probability,  fewer  paths  are  saved.  Either  of  the  last 
two  techniques  has  the  attractive  feature  that  the  decoding 
computational  burden  is  adaptive  to  the  signal-to-noise 
ratio  and  the  data  rate,  and  the  first  of  these  was  selected 
for  use,  with  the  additional  constraint  that  at  least  one 
path  for  each  element  state  is  always  saved.  This  algorithm 
is  coded  in  subroutine  SAVEP. 

Also  in  subroutine  SAVEP,  the  saved  paths  and  their 
identities  are  renumbered  in  order  of  decreasing  probability 
and  a pointer  array  is  maintained  to  identify  the  previous 
node  from  which  the  saved  path  was  extended.  Additionally, 
the  parameters  of  the  Kalman  filters  are  reindexed  to  be 
consistent  with  the  new  path  indices.  After  action  by 
SAVEP,  then,  the  arrays  are  ready  for  the  next  iteration. 
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Before  proceeding  to  the  next  iteration,  however,  the 
trellis  of  saved  paths  is  updated  with  the  new  saved  nodes 
and  connected  to  the  proper  previously  saved  paths  by  using 
the  pointer  array.  Decoding  and  translation  are  accom- 
plished within  siabroutine  TRELIS  by  operating  on  the  trellis 
of  saved  paths.  Decoding  is  done  by  finding  the  one  node, 
at  sufficient  delay,  from  which  all  successor  paths  origin- 
ate. If  no  such  single  node  exists  within  the  trellis  for 
a maximum  delay  of  200  samples  (1  second  delay)  then  decoding 
is  obtained  by  reading  the  node  at  delay  200  which  is 
connected  to  the  current  highest  probability  path,  and 
all  other  paths  not  originating  from  this  node  are  deleted 
from  the  trellis.  Since  the  text  has  been  modeled  by  a 
source  of  equiprobable , independent  letters,  translation 
is  done  by  a simple  mapping  of  the  decoded  Morse  symbols 
into  the  proper  letters  and  numerals. 

There  are  three  auxiliary  processing  routines  for  pre- 
processing of  the  signal,  intended  to  simulate  the  operation 
of  a receiver,  bandpass  filter  and  envelope  detector,  along 
with  the  routine  to  estimate  the  noise  power  in  the  detected 
signal  and  provide  a zero-mean  noise  process.  Subroutine 
RCVR  converts  the  incoming  signal  at  carrier  frequency 
to  a frequency  of  1000  Hz  using  an  8 kHz  sample  rate,  and 
provides  a single-pole  500  Hz  BW  band-pass  filter.  Sub- 
routine BPFDET  implements  the  100  Hz  bandwidth  band-pass 
filter  by  a series  of  two  digital  resonators  centered  at 
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1000  Hz,  and  accomplishes  envelope  detection.  The  low  pass 
filter  of  the  envelope  detector  is  a 100  Hz  bandwidth  3- 
pole  Chebyshev  filter.  Subroutine  NOISE  estimates  the  noise 
power  present  during  a space  condition  by  obtaining  the 
minimum  value  of  the  envelope  detected  signal  over  a period 
of  240  samples  (1.2  seconds).  This  minimum  value  is  ob- 
tained at  each  5-msec  sample  point  and  averaged.  The 
average  is  then  scaled,  with  the  scale  parameter  selected 
empirically,  to  provide  the  estimate  of  the  mean  value 
of  the  envelope  detected  output  during  a space.  This  esti- 
mate is  subtracted  from  the  envelope  detector  output  to 
provide  an  approximation  to  a zero-mean  noise  process;  RN, 
the  estimate  of  noise  power  in  the  detected  output  is  then 
given  by  2u^  . 
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IX.  SIMULATION  RESULTS 

The  Fortran  coded  algorithm  just  described  has  been 
programmed  on  a PDP-10  time  sharing  system,  along  with  a 
signal  simulation  routine  to  generate  a Morse  code  message, 
a routine  to  simulate  transmitter  effects,  and  a channel 
model  routine.  The  text  generation  routine  selects  letters 
and  numerals  either  at  random  or  from  a pre-defined  text 
file.  The  corresponding  Morse  code  sequences  are  generated 
by  a table  look-up,  and  the  durations  of  each  element  are 
randomized  according  to  a selectable  probability  law.  (For 
the  results  presented  here,  the  probability  law  used  was  a 
truncated  gaussian  such  that  no  element  is  ever  less  than 
16  msec  or  greater  than  360  msec  in  duration.  The  variance 
was  selected  to  give  the  error  crossover  probabilities  on 
an  element  basis  to  correspond  to  the  good,  fair,  and  poor 
operator  defined  in  section  III.B.)  The  waveform  generated 
by  this  process  is  used  to  modulate  a carrier  of  frequency 
0)^  £ 4 KHZ,  which  is  simulated  by  discrete-time  process 
sampled  at  8 kHz.  This  carrier  is  then  subjected  to  the 
fading  model  (VII. C)  and  white  gaussian  noise  of  selectable 
power  is  added.  This  received  carrier  is  then  input  to 
the  receiver,  bandpass  filter  and  detection  routines  dis- 
cussed previously.  The  output  of  the  envelope  detector, 
adjusted  in  level  by  subroutine  NOISE,  is  then  input  to  the 
main  processing  algorithm,  PROCESS;  the  demodulated,  decoded 
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and  translated  results  are  presented  on  a CRT  from  which 
hard  copies  may  be  obtained. 

The  overall  objective  of  the  simulation  experiment  is 
to  determine  how  well  the  finite-path  suboptimal  estimator 
performs  relative  to  the  optimal  estimator.  Since  it  is 
not  possible  to  code  the  exact  optimal  estimator  due  to 
exponentially  expanding  memory  and  computation,  the  lower 
bounds  an  error  rate  derived  in  Section  III  are  used  as  a 
basis  for  comparison.  Secondly  the  performance  of  the  tree 
decoder  (the  term  tree  decoder  will  be  used  to  refer  to  the 
suboptimal  finite-path  estimator)  relative  to  other  simpler 
techniques  is  to  be  evaluated.  Finally  the  performance  of 
the  tree  decoder  as  a near-optimal  demodulator  for  Morse- 
code  is  to  be  obtained  and  compared  to  the  performance  of 
the  linear  matched  filter  with  integration  time  equal  to 
the  basic  element  duration. 

A.  THE  IDEALIZED  RAM  TREE  DECODER 

The  idealization  assumptions  made  in  Section  III  for 
deriving  the  lower  bounds  on  error  rate  can  be  obtained  by 
constraining  the  estimation  algorithm  to  have  path  branching 
only  at  the  possible  transition  times  of  a synchronous  RAM 
signal,  and  by  making  the  input  a true  baseband  Morse  wave- 
form with  added  white  gaussian  noise  and  no  fading.  This 
experiment  was  run  in  order  to  determine  the  validity  of 
the  lower  bounds  derived  there  and  to  obtain  a data  base 
for  evaluating  the  sensitivity  of  the  tree  decoder  to 
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non-ideal  conditions.  The  results  of  this  experiment  are 
shown  in  Figure  14  for  the  three  cases  of  first-order  and 
second-order  symbols  and  independent  letters.  Clearly 
under  these  ideal  conditions  the  lower  bound  is  very  nearly 
obtainable. 

Also  shown  for  comparison  are  the  results  of  demodulation 
accomplished  by  linear  matched  filtering  with  decoding 
accomplished  by  thresholding  the  durations  at  2T,  where  T 
is  the  basic  element  duration.  These  results  show  that  the 
demodulation  provided  by  the  tree  decoder  is  clearly  superior 
to  the  matched  filter,  and  that  the  independent  letter 
model  is  of  sufficient  complexity  to  obtain  near-optimal 
demodulation . 

Next,  the  effect  of  lack  of  synchronization  was  obtained 
by  removing  the  branching  constraint  on  the  paths,  but 
still  keeping  the  same  idealized  input  signal.  The  results 
are  shown  in  Figure  15.  By  comparing  with  the  results  for 
the  synchronous  case,  it  is  obvious  that  at  the  lower  SNR's 
the  performance  is  degraded. 

The  next  effect  to  be  investigated  was  the  sensitivity 
to  noise  statistics  in  the  estimator's  lack  of  knowledge 
of  the  true  noise  power.  These  results,  snown  in  Table  XIII, 
indicate  that  the  estimator  is  relatively  insensitive  to 
incorrect  estimates  of  noise  power  within  a reasonable 
range. 
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TABLE  XIII 

NOISE  POWER  EST  SENSITIVITY 
(20  wpm  RAM) 

SNR  Est  Used  by  Decoder  (dB) 
9 6 3 2 1 


0 
1 
5 

14 

B.  THE  REALISTIC  HKM  TREE  DECODER 

Although  the  results  discussed  above  are  of  theoretical 
interest  since  they  demonstrate  a high  degree  of  correla- 
tion with  theory,  they  have  little  practical  value  in 
determining  the  performance  of  the  demodulator  and  decoder 
functions  under  more  realistic  signal  conditions.  The 
first  series  of  tests  used  a RAM  signal  as  input,  in  order 
to  correspond  the  results  to  those  above  for  the  idealized 
case  and  to  obtain  a basis  for  comparison  with  the  HRM 
case.  Table  XIV  shows  the  performance  of  the  tree  decoder 
as  a function  of  the  decoder  constraint  length  (decode  delay) 
and  as  a function  of  the  degree  of  optimality  of  the 
estimator.  (The  degree  of  optimality  is  given  by  the 


TRUE  % LTR  Error 

SNR  (dB) 
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TABLE  XIV 

Performance 

of  First- 

Order  Markov  Decoder 

vs . Decode 

Delay  and  Degree  Of  Estimator 

Optimality 

— 50  wpm 

RAM 

Decode  Delay  (Samples) 

Degree  of 

SNR 

Avg . No . 

Optimality 

(100  Hz) 

of  Paths 

0 

40 

200 

(^opt^ 

dB 

Saved 

% Error 

% Error 

% Error 

i 

1 

12 

20 

0 

0 

0 

.98 

9 

20 

9 

5 

5 

' 

6 

20 

68 

45 

45 

j 

r . 

12 

17 

0 

0 

0 

.95 

9 

17 

9 

5 

5 

6 

18 

68 

45 

45 

1 

12 

14 

0 

0 

0 

: .9 

9 

15 

12 

8 

5 

1 

6 

15 

56 

52 

46 

■ 

i 

1 

12 

12 

3 

3 

2 

1 .85 

9 

12 

32 

32 

29 

6 

12 

58 

56 

53 

< 

12 

8 

3 

3 

2 

i 

.8 

9 

8 

38 

39 

36 

I 

6 

8 

68 

67 

63 

! 

parameter 

, discussed  above. 

where  only 

enough  paths 

1 

1 

are  saved  such 

that  the 

sum  of  the  computed 

posterior  path 

J 

probabilities 

These  results  show  that  the 

90% 
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optimal  estimator  with  a decode  delay  of  200  (1  second) 
is  very  nearly  as  good  the  98%  optimal  decoder.  These 
values  were  selected,  then,  for  the  remaining  tests.  Table 
XV  shows  the  performance  of  the  tree  decoder  as  a function 
of  model  complexity,  and  the  improvement  in  performance 
with  increasing  complexity  at  the  lower  SNR's  is  evident. 
For  comparison  the  results  for  the  independent  letter  model 
are  plotted  in  Figure  16  along  with  the  results  for  the 
idealized  case,  and  the  lower  bound  for  envelope  detection. 


TABLE  XV 

PERFORMANCE  OF  DECODER  vs.  MODEL 
COMPLEXITY  - 90%  OPTIMAL  ESTIMATOR,  KAM  SIGNAL 

DECODER  MODEL 


First 

Speed  SNR  (dB)  Order 

(wpm)  (100  Hz)  % Error 

12  0 

50  9 5 

8 14 

7 36 

6 46 

9 0 

20  6 10 

4 12 

3 43 


Second 
Order 
% Error 

Indep 

Char 
% Error 

Avg  no. 
of  paths 
Saved 

0 

0 

14 

4 

3 

15 

11 

5 

15 

30 

16 

16 

41 

35 

16 

0 

0 

8 

6 

3 

8 

9 

6 

9 

38 

31 

9 

! 


i 


132 


The  next  series  of  tests  used  a simulated  hand-keyed 
signal  as  input  at  nominal  speeds  of  20  and  30  wpm.  The 
performance  for  the  good,  fair,  and  poor  keying  character- 
istics (element  error  probabilities  of  .00143,  .0149,  and 
.0403  respectively)  was  evaluated  for  = -9/  and  decode 

delay  = 200  as  a function  of  model  complexity.  These 
results  are  tabulated  in  Table  XVI.  The  result  for  the 
fair  sender  is  shown  in  Figure  17  along  with  the  corres- 
ponding result  for  the  KAM  signal  and  the  theoretical 
lower  bound. 

TABLE  XVI 


Decoder  Performance 

For  Simulated 

Hand- 

Keyed  Morse 

30  wpm 

20  wpm 

Sending 

SNR  (dB) 

% 

Letter 

Avg  No 

of 

% Letter 

Avg 

Quality 

(100  Hz) 

Error 

Paths 

Saved 

Error 

Path! 

9 

3 

8 

1 

9 

Good 

6 

5 

8 

4 

10 

(Sending 

4 

36 

9 

6 

10 

Error  Rate 
= 1%) 

3 

- 

9 

31 

11 

9 

5 

9 

4 

10 

Fair 

6 

7 

10 

6 

10 

(Sending 

4 

42 

10 

8 

11 

Error  Rate 
= 10%) 

3 

- 

11 

34 

11 

9 

12 

11 

11 

12 

Poor 

6 

13 

11 

13 

13 

(Sending 

4 

46 

12 

14 

13 

Error  Rate 
= 25%) 

3 

- 

12 

38 

14 
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The  adaptability  of  the  decoder  to  abrupt  changes  in 
speed  of  transmission  was  next  evaluated  at  several  values 
of  SNR.  This  test  was  run  by  causing  an  abrupt  speed 
change  to  occur  after  every  tenth  letter.  The  output  was 
then  compared  to  the  output  for  the  no  speed  change  case 
to  obtain  the  extra  errors  introduced  by  the  speed  change. 
This  increase  in  error  caused  by  speed  change  is  tabulated 
in  Table  XVII,  as  a function  of  the  magnitude  of  speed 
change  and  SNR.  A KAM  signal  was  used  for  the  50  wpm  speed, 
and  a fair  sending  operator  was  simulated  for  the  30  and 
20  wpm  signals. 


TABLE  XVII 


Decoder  Speed  Adaptability 


Speed  of 

Previous  Segment 


% Error  Increase  Over 
Constant  Speed 


9 dB 


8 dB 


6 dB 


New  Speed 


c 

I 


4 


In  order  to  compare  the  decoder  performance  with  the 
performance  of  the  MAUDE  algorithm  and  Howe's  quasi-Bayes 
decoder  [14] , the  decoder  was  next  tested  against  simu- 
lated hand-keyed  signals  using  the  same  mark/space  durations 
that  were  used  in  Howe's  tests.  The  simulated  signals 
consisted  of  the  following  keying  characteristics: 

51  - Moderate  variance  handkeyed:  Mark-space  sequence 
with  nominal  1-3-7  mean  element  duration  ratios  and  element 
standard  deviation-to-mean  ratio  of  0.2,  nominal  sending 
speed  of  15  wpm.  (E  , the  average  sending  letter-error 

S 

rate  = 10%)  . 

52  - Abrupt  speed  changes,  low  variance  handkeyed: 
Mark-space  sequence  with  nominal  1-3-7  element  duration 
ratios  and  element  standard  deviation  to  mean  ratios  of 
0.15  with  abrupt  nominal  speed  changes  among  10,  15,  20 
wpm  rates.  (E^,  each  speed  segment,  = 3%). 

53  - Gradual  speed  change,  low  variance  manual:  Same 
as  S2  above,  but  with  gradual  speed  changes  between 
approximately  10  and  20  wpm  over  a period  of  30  seconds. 

Each  of  these  files  was  used  to  modulate  a carrier  of 
constcint  amplitude  to  which  white  gaussian  noise  was  added 
for  signal-to-noise  ratios  of  12  dB,  9 dB,  6 dB  referenced 
to  100  Hz.  The  results  of  this  test  are  shown  in  Table 
XVIII.  A comparison  of  these  results  for  the  high  SNR 
case  (the  only  case  considered  by  Howe)  with  the  performance 
of  the  quasi-Bayes  and  MAUDE  algorithms  is  shown  in  Table 
XIX. 
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TABLE  XVIII 

DECODER  PERFORMANCE  FOR  SIMULATED  HAND-KEYED 
MORSE  USING  HOVIE'S  MARK-SPACE  FILES 


File 

12 

SNR  (dB) 

9 

6 

% Error 

% Error 

% Error 

SI 

11 

11 

24 

S2 

4 

6 

11 

S3 

5 

6 

13 

TABLE  XIX 

COMPARISON  OF  TREE  DECODER  WITH  MAUDE  AND 
HOWE'S  QUASI-BAYES  DECODER,  HIGH  SNR 


File  Decoder  Algorithm 


Tree 
% Error 

MAUDE* 

% Error 

Quasi -Bayes* 
% Error 

SI 

11 

20 

8 

S2 

4 

12 

5 

S3 

5 

14 

6 

* Data 

for  MAUDE  & 

Quasi-Bayes 

From  [14,  p.  74] 
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C.  STATISTICAL  SIGNIFICANCE  OF  EXPERIMENTAL  RESULTS 

The  sample  size  used  in  each  of  the  experiments  des- 
cribed was  approximately  200  letters.  Since  the  sample 
size  is  greater  than  30,  and  since  each  experiment  was 
performed  under  well-controlled  conditions,  the  outcome 
of  each  experiment  (proportion  of  letter  errors)  may  be 
reasonably  assumed  to  be  a sample  point  arising  from  a 
gaussian  density.  Under  this  assumption,  the  following 
90%  confidence  intervals  [23]  are  applicable  (Tcible  XX)  . 


TABLE  XX 


9 0%- CONFIDENCE  INTERVAL 

FOR  EXPERIMENTAL  RESULTS 

MEASURED  EXPERIMENTAL 
ERROR  RATE 

90%  CONFIDENCE 
INTERVAL 

5% 

3%-  8% 

10% 

7%-14% 

15% 

11%-19% 

20% 

15%-26% 

25% 

20%-31% 

30% 

24%-36% 

I 
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While  the  relatively  small  sample  size  of  200  letters  is 
adequate  for  the  well-controlled  simulation  experiments, 
because  of  the  consistency  of  the  input  signals,  a much 
larger  sample  size  would  be  required  for  testing  against 
actual  data.  Because  of  the  lengthy  processing  time 
required  on  the  PDP-10  implementation  (one  minute  of  data 
requires  approximately  20  minutes  of  processing  time) , 
however,  it  was  not  feasible  to  obtain  large  quantities 
of  test  data  against  actual  signals.  The  following  field 
results  given  in  Tables  XXI  and  XXII,  therefore  should  be 
considered  a proof  of  feasibility  of  the  tree-decoder,  but 
not  necessarily  typical  of  results  to  be  expected  under  a 
wide  range  of  signal  and  keying  characteristics. 


In  order  to  obtain  an  estimate  of  the  projected 
performance  of  the  tree  decoder  under  actual  signal  and 


ch2mnel  conditions,  the  algorithm  was  tested  against  several  jj 

tape  recordings  of  signals  made  in  the  field.  Analog  tape 

recordings  «-f  the  output  of  a receiver  using  a 4 kHz  IF  * ' 

band  width  with  fast-attack,  moderate-speed  decay  (approx.  j 

200  msec)  AGC  were  made.  These  tapes  were  digitized  using  I 

1 

< 

a sample  rate  of  8 kHz.  Each  cut  is  approximately  50 

seconds  in  duration,  resulting  in  a relatively  small,  but  | 

significant,  data  base  for  analysis.  The  text  in  each  case  | ■ 

was  context-free,  and  all  signals  were  of  sufficiently  high 

j 

signal-to-noise  ratio  so  that  the  true  transmitted  text  i 

could  be  recovered  from  the  detected  output.  The  results  ^ 

1 

of  these  tests  are  shown  in  Tables  XXI  and  XXII 
for  the  KAM  and  HKM  signals  respectively. 

' 

TABLE  XXI  j 

PERFORMANCE  OF  TREE  DECODER  AGAINST 

ACTUAL  SIGNALS,  KAM  SENDER  j 

♦ ' 


Sample 

Data  Rate 
(wpm) 

Avg  SNR  (dB) 
(100  Hz) 

Letter 

(%) 

1 

35 

20 

1% 

2 

30 

16 

2% 

3 

28 

16 

1% 

4 

32 

18 

10% 

5 

30 

20 

8% 
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1 TABLE  XXII 

PERFORMANCE  OF  TREE  DECODER  AGAINST 
ACTUAL  SIGNALS,  HKM  SENDER 


Seunple 


Data  Rate 
(wpm) 


Avg  SNR  (dB) 
(100  Hz) 


Letter  Error 
(%) 


2 

16 

16 

3 

1 3 

22 

18 

15 

4 

20 

20 

8 

The  disappointing  results  for  samples  4 and  5 of  the 
RAM  signals  are  attributed  to  two  effects  observed  on  these 
cuts.  S2unple  4 contains  several  long  sequences  of  high- 
level  "static"  or  "burst"  noise,  which  appear  in  the 
envelope-detected  output  as  energy  which  is  inseparable 
from  true  marks  of  the  desired  signal.  Although  these 
false  marks  are  of  lower  level  than  the  actual  signal, 
the  algorithm  assumes  that  they  are  faded  marks  of  the 
incoming  signal  and  demodulates  them  as  such.  Although 
the  algorithm  successfully  rejects  many  of  the  shorter 
spurious  marks  because  they  are  inconsistent  with  the 
speed  of  transmission,  enough  are  accepted  as  valid  marks 
to  cause  the  error  rate  to  be  high. 

In  the  case  of  sample  5,  all  of  the  errors  are  attributed 
to  a low  level  Morse  interferer  which  becomes  predominant 
when  the  desired  signal  is  in  a word  space  or  pause  condition. 
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During  these  times,  the  receiver  gain  is  not  controlled 
by  the  relatively  high-level  desired  signal,  and  the  under- 
lying interferer  is  of  sufficient  SNR  (approx.  8 dB)  to 
be  demodulated  by  the  tree  decoder  algorithm. 

For  the  HKM  cuts,  the  comparatively  high  error  rates 
for  samples  3 and  4 are  attributed  to  the  scune  type  of 
interference/AGC  effect  discussed  above,  although  in  sample 
3 the  interferer  is  one  lag  of  an  FSK  teletype  signal.  For 
all  the  HKM  cuts,  the  sending  quality  is  rated  as  good-to-fair . 
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XI.  SUMMARY  AND  CONCLUSIONS 

The  extinction  of  communication  by  Morse  telegraphy 
has  been  repeatedly  predicted  aperiodically  since  about 
1950.  While  the  commercial  use  of  this  mode  of  communica- 
tions is  virtually  nonexistent  in  the  U.S.,  except  for  some 
maritime  services,  it  is  still  used  in  the  military  services 
of  many  countries.  The  reliability  of  Morse  links  is 
well-known  and  long-distance  communication,  particularly  at 
HF,  is  possible  under  conditions  of  interference  and  atmos- 
pherics which  would  render  other  means  of  communication 
useless.  The  simplicity,  reliability,  and  efficiency  of 
the  receiver  (the  human  mind)  preclude  extinction  of  this 
oldest  form  of  successful  electrical  communications. 

Radio  communication  between  two  persons  using  Morse 
code  is  a distinctly  human  process , involving  nuances  of 
code  variations  and  tacitly  ass\imed  conventions  between 
the  communicators,  which  make  machine  transcription  of 
the  human-sent  code  particularly  difficult.  The  theoretical 
development  of  a unified  structure  for  modeling  a Morse 
message  (not  just  the  code  itself)  presented  in  this  report 
shows  how  the  various  aspects  of  linguistic  context, 
formatting,  individualistic  operator  sending  peculiarities, 
and  code  symbol  dependencies  may  be  combined  in  the  design 
of  an  optimal  Morse  translator.  As  a practical  excimple  of 
modeling  of  the  Morse  message  within  this  structure,  a 
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model  for  independent  equally-likely  letter  messages  was 
derived,  and  the  resulting  decoder  was  tested  against  a 
variety  of  simulated  and  actual  Morse  messages. 

The  results  of  the  simulations  show  that  the  error 
rate  of  the  idealized  KAM  decoder  [Fig.  14,15]  approaches 
the  theoretical  lower  bound  for  the  gaussian  channel, 
derived  from  coding  theory  argiiments,  and  that  the  increase 
in  performance  compared  to  a linear  dot-matched  filter  can 
be  significant  at  low  signal-to-noise  ratios.  Secondly, 
the  performance  of  the  HKM  decoder  using  envelope  detection 
[Fig.  16]  was  demonstrated  to  be  only  moderately  sensitive 
to  the  non-gaussian  nature  of  the  noise  statistics  at  the 
output  of  the  envelope  detector,  for  SNR's  above  approxi- 
mately 4 dB  in  100  Hz.  Finally  the  performance  of  the  HKM 
tree  decoder  against  simulated  hand-keyed  Morse  [Fig.  17] 
shows  that,  under  these  laboratory  conditions,  the  tree 
decoder  can  be  expected  to  provide  an  error  rate  no  worse 
than  that  of  a human  transcriber  for:  (1)  output  copy  with 
an  acceptable  error  of  10%  or  less;  (2)  independent  equally- 
likely  letter  messages.  In  comparison  with  the  MAUDE 
algorithm,  [Table  xix]  the  tree  decoder  shows  a significant 
decrease  in  error  rate  on  the  simulated  data,  while  in 
comparison  with  Howe ' s Quasi-Bayes  decoder  the  error  rates 
are  about  the  Scime. 


These  results  show  that  for  the  case  of  random  letter 
text,  the  performance  of  a human  operator  can  be  veiry  nearly 
obtained  by  optimal  non-linear  processing  techniques.  The 
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estimation  algorithm  derived  in  this  investigation  is 
adaptive  to  speed  cheuiges,  varying  noise  levels  and  fading 
signals  and  has  performed  for  approximately  90  hours  of 
running  time  (approximately  21,000  characters  total)  without 
exhibiting  emy  noticable  signs  of  divergence  or  instability. 
The  computational  burden  is  severe,  however,  and  for  prac- 
tical use  would  require  possibly  a pipe-lined  approach 
with  digital  hardware  under  microprocessor  control. 

The  strength  of  the  tree  decoder  for  random  letters 
lies  primarily  in  its  use  of  the  Morse  code  structure  to 
perform  channel  decoding,  i.e.,  demodulation,  and  secon- 
darily in  its  use  of  the  structure  to  accomplish  source 
decoding.  For  contextual  messages,  however,  a well- 
constructed  model  of  the  linguistics,  semantics,  ad  format 
embodied  in  the  structure  of  an  appropriate  f^^  text  function, 
describing  the  evolution  of  the  message  states  as  a finite 
state  machine,  would  add  significantly  to  the  error-correction 
capability  of  the  decoder.  To  the  extent  that  such  a function 
can  accurately  describe  the  Morse  message  linguistically, 
the  error-rate  for  contextual  messages  may  be  made  to 
approach  that  for  the  human  operator.  As  such,  the  parallel 
between  the  problems  of  Morse  translation  and  automatic 
speech  understanding  is  evident  and  therein  lies  the  rub, 
and  perhaps,  the  solution. 
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APPENDIX 

SAMPLES  OF  OUTPUT  DATA 

I.  In  order  to  obtain  an  intuitive  appeal  for  the  errors 
produced  by  the  tree  decoder,  several  examples  of 
output  copy  are  shown  below  for  various  levels  of 
keying  quality  and  signal-to-noise  ratios.  Errors 
are  indicated  by  an  underline. 

A.  50  wpm,  KAM,  12  dB  SNR; 

A LAZY  BROWN  DOG  JUMPED  OVER  2 LOGS 
ON  A SUNNY  SUNDAY  AFTERNOON 

B.  20  wpm.  Fair  Key,  9 dB  SNR: 

A LAZY  BROWN  DOG  JU_^ED  OVF  2 LOGS 
ON  I SUNNY  SUNDAY  AMTERNOON 

C.  20  wpm.  Fair  Key,  6 dB  SNR: 

A LS7  BORWN  DOZ_  JUMPED  JHF  2 LOGS 
ON  A SUNNY  SUDDAS  AFDRNOON 

D.  20  wpm.  Fair  Key,  6 dB  SNR  (same  as  C. , but  with 
a different  noise  sequence) : 

A LSZY  BROWN  DOZ  JUMPED  OVEL  2 LOGS 
ON  A SUNNY  lUTSANO  AFTEGNOON 


147 


[ 

I 


f; 


L 

> 

E 

f 

r 

! 


j-.. 


E.  20  wpm.  Fair  Key,  4 dB  SNR 

V LAZX  BROWN  D^  JUMPED  JVEL  IMI 
L_OGS  ON  A SUNNY  IM6ACN  AFORNOON 

F.  15  wpm,  KAM,  12  dB  SNR 

CWA6  DE  LAB  lAW  THE  QUICK  GREY  FOX 
JUMPED  OVER  THE  LAZY  BROWN  DOG  ON  A 
SUNNY  SUMMER  AFTERNOON.  THIS  IS  A 
TEST.  VW  JVXI  JGBA  OBEY  IQNH 
OPRP  CIPU  URUC  RHIC  MUJX  SKYQ 

G.  15  wpm.  Fair  Key,  12  dB  SNR 

CWA6  DE  HHH  lAW  THE  QUICK  GREY  FOX 
JUMPL  OVER  THE  LAZY  BROWN  NROGON 
^UNNY  SUMMER  AFTERNOON.  6 IS  IS  A 
NSCK  VW  JVXI  JGBA  OBEY  I^H 
OPRP  CIPU  UKUC  RMIC  MUJX  SKYQ 

H.  15  wpm.  Fair  Key,  6 dB  SNR 

C%A6  DE  5HH  lAW  5E  QUICO  GREY  FOX 
JUMPED  OHER  T5  LAZY  B50W5  NROG  QN 
^UNNY  SUMMER  AFTERNOON  £5 IS  A 
NSCK  VW  JVXI  JGBA  GBE3SHIH  OPRAS 
CIPU  SKUC  RHIC  MUJX  SKYQ 
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II.  The  waveforms  shown  in  the  following  Figures  (Fig. 


FIGURE  18a.  Output  Waveforms 


FIGURE  18b.  Output  Waveforms 


t Si 


FIGURE  18c.  Output  Waveforms 


FIGURE  18d.  Output  Waveforms 


FIGURE  18e.  Output .Waveforms 


FIGURE  18f.  Output  Waveforms 


FIGURE  18g.  Output  Waveforms 


FIGURE  18h.  Output  Waveforms 


FIGURE  18i.  Output  Waveforms 


COMPUTER  PROGRAMS 


0OtO0 
00230 
00300 
00400 
00500 
03600 
00700 
00A00 
00900 
01030 
01130 
01203 
01300 
01400 
31S00 
01630 
31730 
01333 
0 1 900 
02300 
32133 
32230 
02303 
02403 
32530 
32603 
02733 
32e'3'3 
32903 
33000 
33103 


I\TeGE«  E'.MHAT.XHaT 

OnENSION  SI  (512)  I S2  (512)  , S3  (SI  2) 

OIMgfJSTON  S4(512) 

DaTa  RN/,1/ 

PATa  NP/3/ 

CALL  INITL 
CALL  INPUTL 

00  ? i'tnusia 
00  3 N2cl,16 
CALL  SIMSGl (X,ZSIG) 

CALL  KCV«(ZSIG,ZRCV) 

CALL  flPFPETCZRCV.Z'JET) 

MPawP*! 

IF(nP.LT,43)  GQ  TC  3 

NPS0 

CALL  nOIS£(ZOET,RM,Z) 

CALL  P»0CESC7,RM,XHAT,PX,fcLPHAT,LTRHAT) 

continue 

N‘«N  I 

CALL  STaTS(ZDET,Z  .PX  , XH A T , St , S2 , S3 , S4 , N) 
CONTINUE 

CALL  0ISPlACS1,S2,S3,S4) 

GJ  TO  1 

STOP 

E.NO 


nrcT'^iif III  - 

DOi.AV/uuiBLt  LUPY 
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easan 

e'33<d^ 

33433 

33/^0 

30303 

00930 

01303 

01100 

31200 

31303 

01403 

01400 
31703 
31333 
01930 
023  40 

ears'* 

32200 

02300 

02400 

325015 

3a«>33 

02703 

324?a 
32903 
03030 
0it  00 
33253 
33300 
33403 
33530 
03400 
037010 
03430 
33900 
0 4303 
04100 
0 42  le 
34  300 
04403 
04500 
34403 
04  7/0 
04300 
34  9:50 
35300 
05100 
3520  0 
05300 
054  0 0 
05500 
05400 
0570/ 
35303 
0590’J 
06000 


subroutine  IMPUTL 

DIMENSION  ES5P(6),F0EV(4) 

COMMOM/6LK1  / TAU/BLi<4/DMeAN,  XOUR,PSeP#E0EV 
r:0M,40N/BLK2/RC,  inCHIRP,  ASIGMA,88IGMA,PHISGM, 
2RSIGM,Ti;HXRP»GAMMA 

oat  A TAU/,PQ3l25/,e3EP/l ,3, 1 ,3,7, 14/,EDEV/4*0,/ 
OATa  XOJR//,/ 


Type  103 

130  KORMATtn, 'INPUT  KEYING  PARMS:  RATE.MEAN  ELEM  DURATIONS') 
ACCENT  230, RATE, (ESEP(K) ,K*1 ,b) 
type  153 

l53  PORMATdY, 'INPUT  ELEM  OURATION  STD  OEVIaTIONS') 

ACCEPT  200,  (EDEV(K)  ,i<al,6) 

2-3a  F0RMaT(7F) 

TYPE  303 

333  FUWMATdX, 'IMPUT  SI6  HARMS-  A V AH , 8 V AR  , FCH I RP , TCH I RP , PHI  V AR  ' ) 
ACCEPT  230, AVAR,8VA«,FCHIRP,TCHIRP,PHIVAR 
type  40/ 

4/'0  FQR.'iATdX, 'INPUT  STG  PAHmS:  GamM  A , FREQ , NO  ISE  ' ) 

ACCEPT  233, gamma, FC,HNOISE 

ASIGMA«SQRT  C A VAR) 

53TGMASoflRT(9VAR) 

PuIiGMtSQHT  CPMI VAR) 

HSTG-iaSUHr  (RNOISE) 

CMEaN»120'!3,/RaTE 

0Cs6.23319*FC 

wCH  1 HP »b, 2 831 4 *FCH I R? 


IF  (ESEPd)  .ME,/,)  GO  TO  533 
EaEPCDal, 

EsE?C2)a3. 

EjEPC3)al, 

ESEPfa) a3, 
f.SEPC55a7, 

ESEP<;b)8l4. 


5/0  HerijH:< 

ENT 


BBI  AVAIUBIE  COPY 


SURHOuri‘J£  INITL 

OI'^ENsST  JN  IELM3T  (430)  , RAM  1(14), IUAM<C4) 
m 'PNSY  JM  FLEMTRd6,4)  ,HTRAnS(5,2)  , ISX  (6) 
ni  MENS  TON  "'EMFC'V(a03,b)  ,LTRmAP(400)  , rALPH(73) 
0!  IF.  NS  TON  (b,  , MEMPR  (6, 6)  , I BLANK  (430) 

DIMENSION  I A PRAY  (8) , I text (200) 

CCNmP.^/BLkLam/IELMST,  RAM)  , ILAMX 

CON'ON/MLkRaT/MEMDFL 

CU’^nC  x/BLKrl.M/PLEMTP/SLKSPD/RTRANSfMEMPR 
CON-nl't/ai  KMEM/menfCn/SUKS  / ISX 
CJM/ON/RLi^ThN/LTHMAP,  I ALPM,  I8LANK 


1 

J 


PiblQta 

06300 
06400 
06500 
06600 
06700 
06300 
06410 
07003 
37100 
3 7 200 
07330 
0 7 403 
07S30 
07633 
07703 
07500 
37710 
38030 
33120 
08200 
05303 
08400 
08533 
08520 
08700 
08800 

0 8 9 y 0 
09030 
39133 
39213 
09333 
39433 
095^^3 
09630 
397a3 
09813 
0993'3 

1 3 '3  3 3 
1(0133 
10233 
10333 
10433 

10530 
10603 
1 0 703 

10531 
1090'1 
11333 

11103 

11231 

U3-*3 

11430 
1 I5:t3 
1163  s* 
1 1 72  3 
1 i8«3 
11301 
1 2300 


2 

2 

2 

2 

2 

2 


2 


2 

2 

2 

2 

2 


2 

2 

2 

2 

2 


C0Mfi0N/3l.KTXT/TTeXT 


HaTa  ISX/1 , 1 ,0, 0,0,0/ 

OaTa  mF.mFCN/9,  1 1,1 3, 15, 9, 11, 13, 1 5, 9, 0,1 1, 0,1 3, 0,1 5,0, 

384*0 , 

13»12»  14, 16, 13, 12, 14, 16,0, 10, 0,12, 0,  14, 0,  16, 384*0, 

1,3,3,0,5,3,0,0,1,5,1,5,1,5,1,5,384*0, 

0,2,3,0,3,6,0,0,2,6,2,6,2,6,2,6,334*0, 

0,0,3,0,0,3,7,0,3,7,3,7,3,7,3,7,384*0, 

0,0,3,4,3,0,0,8,4,8,4,8,4,8,4,8,384*0/ 

CATa  If:l.(-S7/l,2,3,4,5,6,7,a,9,  f 3,  11,12, 
13,14,15,16,384*0/ 

0aTa  II.  A3  1/3, 4, 5, 6, 3, 4, 5, 6, 1,2, 1,2, 1 ,2, 1,2/ 

CaTa  ILa;^X/1  , 1 ,0,9,0,0/ 


oat  A UTR3AP/3,a,S,6,3,4,5,6, 1 ,2,1 ,2, 1 ,2, 1 ,2,384*0/ 

DaTa  lAl.PH/»A»,»R»,»C','n*,»E»,*P','G','^S'I'» 

'v',  'U*,  'X%  *Y',  'Z',  '1',  '2',  '3%  '4',  'S',  '6',  *7', 

' 3 ' , ' 9 ' , ' -3  ' » ' ; ' » ' J ' » ' X ' , ' & ' , 0 , 0 , ' X ' , ' , ' , ' AS  ' , ' SN  ' , 
0,0,0,0,  '•MR*  , 'GA',  'a<*,  'AP',  'SK',0,0,0,0, 

*IMI',3,3,1,ci,*8T',0,0,0,  'EEE'/ 


PATa  IBLANX/a00*0/ 


data  ELEf'T9/,55,  .5,  .5,  .5,  ,55,  .5,  ,5,  .5,8*0,, 
,4*5, .5, ,5, ,5, ,45, ,5, ,5, ,5, 9*0,, 

8*0., ,581 , ,54, ,923, ,923, ,923, ,923, .95, .95, 
a *0, , ,335, ,376, ,062, ,062, ,062, ,062, ,04, ,04, 

8 • 0. , ,167, ,069, .012, .012, .012, ,012, ,009, .009, 
3*0, , .915, ,015, ,003, ,003, ,003, , 003 , , 30 1 , . 00 1 / 


DATa  R72Ano/,1,,2,,4,,2,,1,,15,,2,,3,,2,,15/ 

Hat  A ME.  il)EL/0, 0,2, 2, 5, 13,0,0,2,2,5, 10, 

2 2, 2, 0,3, 0,0, 2, 2, 0,0, 3, 0,2, 2, 0,0, 0,0, 

2 2, 2,0, 0,0,0/ 

OAT  A ME,  (OR/ 0,0, I ,2, 1 ,2,0,0, 1,2, I ,2, 1 , 1,3, 0,3,0, 
2 l,l,3,0,0,3,1,l,0,0,0,C,l,l,M,0,0,0/ 


33 

11 


0f’Eu(U'firs23,FlUEs*M0«S£M*) 

00  10  T*S330 

9KAD(29i,301  (IARPAY  (K)  ,K*l  ,8) 

FuRwAT  t9l3) 

00  11  3»1,6 
RE^^FCr^  rl,K)ilARRAY(K->’2) 

LTPM4PCn*TMPPAYf  1) 
lt.UMST(I)»rARWAY72) 

IF  C (TtLMSTri)  .FO,  71,09.  (ItLriSTdl  ,F.G,3)) 


BtSt  AVAllABU  IM 


I4t-AvKCn«» 

Tr  CClEUiaxcn ,FG,8).0H, (ItLMSTri) ,60,41) 
T8LA^^ (I)s2 

co^  rivuE 


p^ofilp  ?:; 

OPEMU'i  JTs20,F!U6«'(jntP-JT') 

00  51 

v-RlTe(2/,a’')  (^'e•^FC^  (I,^)  ,K*l,6J 


I 


U10id 

12200 

40 

FuPMATdaX, 6(13,2X5) 

12300 

12a00 

50 

CONTINUE 

12500 

ENOFILE  23 

12600 

12700 

OPEN (UNI r *20, file* 'TEXT') 

12600 

on  60  1*1,105 

12‘#00 

H£AD(23,70)  iTEXTd) 

1 3000 

70 

F0RMaT(I2) 

13100 

60 

continue 

13230 

ENOFILE  20 

1 3300 
13400 

RETURN 

13500 

ENO 

BtSl  AVAllABlt  COPV 
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{901U9 

00290 

00300 

00400 

00500 

00«>00 

00700 

00800 

00900 

01000 

01100 

01200 

0130"' 

01400 

015C0 
01600 
01700 
013C0 
01900 
02003 
02 100 
02203 
02300 

02400 
02500 
02600 
02  700 
028091 
02900 
23300 
03100 
03200 
03300 
034(00 
03509 
23620 
03700 
03800 
03'»00 
04003 
04103 
04  2 3 3 
043/0 
044j3 
04500 

fk  t\  4.  . 4 <11 
w «,  • . 

04703 
04  803 
04900 
05000 
05100 
05203 
2530/ 
25430 
0550? 
05h?/ 
05733 
0580? 
259^-3 
0b30'/ 


SUBSOUTIME  Slf^SGl  (X,SIG) 

CQmMOn/BLM/TAU 

CQMNi0n/3(.K2/''<C,WCHIRP,  ASIGMA.BSIGMA.PHISGM, 
afiSIGM,  rCHIPP, GAMMA 
DATA  XLAST/1  ,/,BeTA/1 ,/ 

OATa  AMP/1  , / ,8FaCiE/B,/,  theta /0,/,  PH  1/0,/ 

DURsBETa 
call  8eYCLl!P.X) 

BETa*B5TA*  (I ,-/-yUAST+2,*X*XLASTl+J  , 

Tk*  <*  ( I , -XU  AST) 

XUA5T«X 

CALL  RA?-JO'(C/*,  1 , 3.  , ASIGMA) 
amp«4mp+  rK<t^' 

IF(aH?,LT.,01)  AMPs.Ot 

CALL  RAmC.MCa',  I ,0.  ,flSIGMA) 
8FA0EaGAMi<iA*6FADE<>4 

AHPB^AMP  + tl^ArC 

IF  (AMpfl,LT,2,33n  BFADE 40,221 -AMP 
A(lPd«AMp-».8FAn£ 

TnUR«i0!50,*7Aj*t3ETA 

WCHHPaXmwCHlRP^EXP (-TOUR/ T CH I HP ) 
THETAsTrtETA-f  (wCtWCNHP)  aTAU 
ThETAaAMOO (THETA, 6,283 19) 

CaLU  RAMON(k,,  I ,9,  ,PHISGM) 

PmI  aPHl  + Tx.*w 
P^IaA/OD (PHI ,0,28319) 


Sir,aX«Ai'-lPl3*ST.\(THETA  + PHI) 

Call  han()n(zn,  1 ,0, ,piSir,M) 
SIGsSlG  + Z'^ 


RETijRf.j 

EM0 

SliPHOUTivE  KFYfDL'R,X) 

ni.-ENilUM  ESEP(b)  ,eOEV  (6)  ,HCPSE(10»40) 
niMt'.MilM  TGliT  (500)  , TSYMPl  (6)  . I TEXT  (200) 

C JMm  (IN /aUK  END/ IE  Mu 

CG/MCt./BUK  I / TAiJ/PLt'6/CMEAN,  xnUPjESEP,  EOEV 

C OhmOn/bI  K (XT/ TTExT 

OaTa  I^/'^^'n003/3B'300/ 

uaT  A UTH/2  '’  / , nEuh/0  / ,N//  / ,nuTR/1  / 

UaTa  -lOri^t/l  , 3, 2, 3, 3,0, 2, B,  3,0, 
i 2, 3, I, 3, 1,3, 1,0, 0,3, 2, 3, 1,3, 1,3, 1,9, 3,0, 

2, 3, 1,3,1,*, 9,3, 3, 3, 1,3, 0,3, 0,0, 0,3, 0,3, 

1 . 3 , 1 , 3 , 2 , 3 , 1 , 0 , 3 , 3 , 2 , 3 , P , 3 , 1 , 0 , 3 , 0 , 0 , 0 , 

1 , 3 , 1 , 3 , ’ , 3 , 1 , 3 , 3 , rs , 1 , 3 , 1 , ,3 , 0 , 3 , 0 , 0 , 0 , 0 , 

1.3. 2. 3. 2. 3, ?,  3, 3, 3, 2, 3, 1,3, 2, 3, 0,2, 0,9', 

1 ,3,^,3,  1 , 3,  1 ,m,0,0,2,3|2,?,0,0,m,0,0,v3, 

2 . 3 , 1 , ? , r , \ , 9 , V0 , 0 , 2 , 3 , 2 , 3 , 2 , 0 , 0 , 0 , 0 , 0 , 

1.3, ?,3,?,3,i,0,m,0,2,3,2,3,1,3,2,2,0,0, 


2 

t,3,2,3,l,0,'0,0,0,0«l,3,l,3 

362j^ 

2 

a, 0,0, 0,0, 0,0, 0,0, 0,1, 3, 1,3 

36320 

2 

1,3, 1,3, 1,3, 2, 0,0, 0,1, 3, 2, 3 

36400 

2 

2, 3, 1,3, 1,3, 2, 0,0, 0,2, 3, 1,3 

36500 

2 

2, 3, 2, 3, 1,3, 1,0, 0,0, 1,3, 2, 3 

3660? 

2 

1,3, 1,3, 2, 3, 2, 3, 2, 0,1, 3, 1,3 

367  00 

2 

1,3, 1,3, 1,3, 1,3, 2, 0,1, 3, 1,3 

06603 

2 

1,3, 1,3, 1,3, 1,0, 2, 3, 2, 3 

06900 

2 

2, 3, 2, i, 2, 3, 1,3, 1,0, 2, 3, 2, 3 

07000 

2 

2,3,2,3,2,3,2,3,2,0,40*0/ 

07  100 

data  ISYf^BU/lH,  , 1H^,  1H  ,1H/ 

07200 

07303 

3ETA*i'^aa,*TAu*nu« 

07400 

IF  C0&TA.I.T.3CUR3  GO  TO  200 

07500 

^ELMaNELf1♦  1 

07600 

IfeLM«Ml19Se(NFU-'^,I.TR) 

07700 

TF  (lEU'^.Nfc,/!  GO  TO  100 

0 7800 

MELMSir) 

07900 

Y*9ANi(IKI 

08000 

I £ L ^ * 4 

0 8 1 00 

1F(Y,GT,,9)  IELMsS 

08200 

IFC(Y.UE..9),aN'0,(Y.GT.,8)3 

08300 

YsRaMCIkJ 

084''J0 

Vs35*(/-,00n+l  , 

08520 

I V «Y 

08600 

lTRsIY*! 

08700 

08830 

GJ  TO  100 

08900 

Ml.  TrsM,  T9+1 

09000 

LTRsTTEXT  INlTFI 

09100 

IFCITR,£Q,8)  lEI.'^sa 

09200 

IF  CuT9.E0.371  ItL.'iaS 

093Z0 

IF  (uTH.tC.3d)  lEL.’isfe 

09  4 33 

!MLTR*NL  T9+1 

09500 

urR«TTExT(MuTH) 

09602 

09  7 G'*' 

1 /G 

^'SN♦  1 

0980*" 

ICUT  C 'l)  «T3ri‘iPu  (leui^) 

09930 

IF  CN.LT.3/M  GO  TO  lUJ 

1 

'm  0 

13130 

NUTHa/ 

132}5  0 

lE^Osl 

10330 

TyRF  9/3 

1 J4.?ii 

900 

FGHf.AT  (/ , / , 1 y , •>  fcMQ  UF  RUM 

10530 

00  10  Xal  , 1 /j 

13630 

Kla(K-n  *50*1 

137  30 

K 2 a ■<  * 5 0 

13^30 

T/D£  riCU'T(L)  ,U»K1  ,K2) 

10930 

1 230 

FOR^ATi/, 1X,5£AI) 

1 10  3 0 

10 

C 0 M T I I'i ' E 

1110^ 

ACCFIPT  t "00,  wait 

1123  3 

11333 

11/ 

Y9aeS£H (TEU") aOMEAM 

1 1430 

Y3TGMaF0P'/CIFL'^)*0.’^EAN 

1 15  J0 

YaHa^ (T6) 

1 16/0 

»«2."(7-.5) 

11730 

X0*JPaX'-  + yax8TGM 

1 18ZP 

IP rxHuP.UT .20.)  xnUHa20. 

1 19Z0 

7*1  . 

IF  riEU'^.CE.  i)  Xt'^. 

BtSl  WMlABlt  COPV 
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00100 

00300 

00300 

00400 

00500 

00«j00 

00700 

0080P 

00900 

01 'VJ?! 
01100 
01230 
01300 
01400 
01503 
01600 
01703 
01800 
01900 
020J0 
02130 
02230 
02300 
02400 
02503 
02600 
02700 
028  30 
02930 
03000 

031 

032  )0 
03300 
03430 
035  33 
03637 
03700 
03rfO0 
03900 
04000 
04  1 .10 
042J0 
04303 
044  J0 
04533 
04607 
04  7-.''7 
• 4437 
•»4933 

057C)0 

05130 

05230 

05300 

054-13 

055  30 
0 5 6 'j  ) 


SUBRnuTr^L  0ISPUA(SI, 32,53,84) 

OIM£NSIO^  SI f512) ,32(512) ,33(512) ,34(512) 
CALL  tRASil 

CALL  PLCTR(ai  ,512,0, )<M, 400) 

CALL  PLOTS(S2,5l2,0,XM,275) 

CALL  PLCTR ':S3,512, 1 , 1 , , 150) 

C-LL  PI.QTh(S4,512,0,Xm,40) 

Call  VIEWC'l*) 

ACCEPT  10M0,>AIT 
1700  FURmaT(a5) 
flETuRM 
END 


SUBHCwlT  INE  3 T ATS  C X T N 1 , X I N2  , X IN3 , X I M4 , 5 1 , 

2 i2,53,S4,^0 

01  -lENSIO^  SI  (512)  ,32(512)  ,53(512)  ,34(512) 

S 1 ( 14 ) a X I \ 1 
32  (is)  4XIN2 

S3(,n)sxI^3 
S4  (N) 8XI^4 

return 

ENO 


SUAROUTlNfc  AUTOCR  (S5,RS) 

01MENSI0‘'  55(512)  ,R3  (51  2)  ,3(1000)  ,RS1  (500) 
OaTa  3/ 1000*0. /, XN/0 , / 


X a X ^ ♦ 1 

CO  100  I a 1,51,10 
S(I)»S5CI) 

P3l  (I) ■0, 

Cu^  TInUE 

DO  277  Ial,5''0 

CQ  30/J  4 a 1,500 

RSI  (1)8^31  (I)*S(K  + T-i)*S(r.) 

CONTINUE 

C0'''T!M'E 

■jO  '40.1  I a 1,500 

R5(l)a(r(S(T)*(x:i-l.)^t481(n)/XN 

CJf'TlNUfc. 


Rfc  TijRn 
E lO 


BESrWAIUBlE  COPY 


aQ\\£(i 

aoatji? 

903ti}3 

SOSv)  J 
0060? 
aMTai' 
eas'^a 

03900 
01033 
01133 
31330 
01330 
01433 
015JW 
01633 
01733 
01^03 
01930 
02030 
02130 
02333 
02330 
024J0 
02533 
02630 
02730 
03433 
02900 
030J0 
03130 
03230 
03330 
0 5433 
03533 
0 36  33 
037^0 
038  30 
03930 
04033 
041^0 
04233 
04333 
04433 

04503 

04630 

04730 

04830 
049n0 
0 3000 
051  -’0 
0523  0 
05330 
05430 
05503 
05600 
03  7:j0 
05800 

05  4 ?'* 

06  0 03 


Sg0>^QuTlNE  PBQCESlZfWN,  XHAT,PX,F.LMHaT,LT9HAT) 

c**  *****  *** 

C This  3U6R0UTTNE  IfMPLF^'ENTS  THE  PROCESSING  ALGORITHM 
C POR  JOINT  DEMODULATION, OECOOING, ANO  TRANSLATION  OF 

C The  received  morse  process,  IT  TAKES  IN  4 N£0  MEASURE- 
C MENf.Z.QF  The  neTECTEO  SIGNAL  EVERY  5 msec  AND  PRO- 
C DUCES  AN  ESTIMATE  OF  THE  CURRENT  KE VST  ATE , ELEMENT 
C STATE, AMO  LETTER  OF  THE  RECEIVED  SIGNAL, 

C 

C DEFINITIONS  OF  VARTA3LE  NAMES; 

c z-  input  sample  of  detecteo  signal 

c RN-  INPUT  NCISe  power  estimate 

c xhat-  Output  estimate  of  keystate 

c ELMHaT-  output  estimate  cf  element  state 

c ltrhat-  Output  estimate  of  letter  state 

c 

C ISAVE-  40,  OF  PREVIOUS  PaThS  SAVE^ 

C IPATH-  TDENTITY  of  saved  path 

C LAMaoA  (I)-!QF4TITy  of  LTR  STATE  OF  SAVED  PATH  I 

C O'JRCD-  DU»ATIC.V  of  element  ON  PATH  I 

C iLRATErn-lDENTITY  QF  DATA  RATE  ON  PATH  I 

C PIN(I,N)-  CQMPUIEO  TRANS  PRQB  FROM  PATH  I TO  STATE  N 

C UAMSAV  (J5 -identity  of  UTR  STATE  AT  NEW  NODE  J 

C IL»SAV  ( JI-IDENTITY  of  data  rate  at  NEw  node  J 

C LNriD(j)-  LIKELIHOOD  VALUE  FDR  NODE  J 

C P(J)-  COMPUTED  POSTERIOR  PRQR  OF  PATH 

C ENDING  AT  NEw  MODE  J 

C pSElE.M(.<J-CC“PUIEO  posterior  PRQ8  OF  £LEM  K 

c spohat  -coho  mean  estimate  qe  instant  data  rate 

C PX-  POSTERIOR  PROB  ThaT  KEYSTATE  EQUALS  1 

C 

C The  EOLLORING  subroutines  are  utilized: 
c TRPRDB-  COMPUTES  transition  PROBASTLITIES 

c PaTm-  computes  identity  of  NEw  PATHS 

c likhd-  computes  the  likelihood  of  each  path  extension 

C PROeP-  computes  posterior  props  of  Each  new  path 

c SPRDP-  ruMPUTES  posterior  PROPS  OF  EACH  STATE 

C SAVf  SAVtS  the  highest  pros  paths 

c iRELls-  Forms  a trelIS  of  Saved  paths 

c TRamSu-  translates  the  LETTER  ESTIMATE 

C 

c all  Tables  of  ccnsiants  are  stored  in  common. 


Real  lkhd 

Integer  el^hat, xh at, paths v .sort 

DIM£MSI.jh  LAMMDa(25)  ,0URf255  , ILRA-TS  (251  , PIN  C?5f  30) 
DIMENSION  LAMSAVf  750).OURSAV(  750l,TL«SAV(  750) 
dimension  LKHD  (7501 ,P (750) ,PSELEM(6) 
dimension  PaThSV(25) ,S0RT(?5) 


oat  A ISAvE/25/ 

DaTa  LA'^poA/25*5/ 

Data  RhaTE/ 5* 1^,5*20,5*30,5*40,5*50/ 
OATa  P/753*l ,/ 


DaTa  la mSAY/750*5/, DU 9/25*10 00,/ 
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I 


i 


_ I 


0611^7 

06220 

06100 

06a00 

06500 

06600 

06700 

0b800 

06600 

0710  3 
07200 
07  300 
07000 
07530 
07600 

0 7 700 
07800 
07600 
03000 
08!  30 
08200 
08300 
03400 
0850'^ 
08630 
087130 
08800 
06600 
G9030 
09103 
09200 
09330 
09400 
095?'' 
09600 
09700 
09753 
09800 
09°G0 
1O0k)'3 
13100 
10200 
10  300 

1'34?0 

10530 
13600 
107  33 
10800 
1293 
1 10k;0 

11133 

1122’' 

1 13?3 
1 ia<  3 
11530 
1 I 60 '3 
11/00 
11800 
1 16,^,0 


data  lL«SAV/750*20/,PAThSV/25*5/ 


C FOR  EACH  3AVeO  PATH,  COMPUTE:  | 

C THAnSiTION  probability  to  nEH  state  CTRPRQ8); 

C IbENTITY  OF  Each  NEW  PATH  EXTENDED  (PATH)/  ! 

C LIKELIHOOD  OF  EACH  STATE  EXTENSION  (LIKHQ)  : 

C 

C 

00  10?  I*1.1SaVE 
IPATHal 

1 

CALL  TRPP08 (IPATH, lambda (I ), OUR CT) ,ILR ATE (T) ,PIN) 

Call  path cipath, lambda cn ,nuR(i) , ilrate ci) ,LAMSAv,nuRSAV, ilr! 

Call  LTKHl)fZ,WN,  TPaTH.LAMBOACI)  ,DUR(I)  , 

2 ILRA^ECI) fPIN.LKHO)  i 

i 

130  CQMTINI'E 

c Having  obtained  all  new  paths,  compute:  i 

c pdvSTerior  probability  of  each  new  path  (PRnBP)i  ! 

C POSTERIOR  probability  Op  KEYSaTE,ELEM  STATE, 

C CCNOITIDNaL  mean  estimate  of  speed  (SPRDB); 

c 

CALL  PR09P rP,PlN, ISAVE,LKHn) 

Cal  L SPRC3 (p, ISaVE, ILRSaV,PELM, KHaT, 

2 SPCHAT.PX) 

xhat»0 

IF  (PX,Gr.6,5)  XHATsl 

c 

C Save  the  BATHS  '<ITH  highest  PROB  AB  TL  I T Y , AND 

c store  The  Values  corresponding  to  these  paths: 
c 

p 


1000 


2 

1 100 
I 

c 

C UPDATE  TRELLTS  ^ITH  NE'l  SAVED  NODES,  AND 

C OBTaT.'-  letter  state  estimate: 

c 

Call  rRE'.IS(I5AVE,PATHSV,LAMBDA,  tmAX) 

200  PETijR;. 

Ef.P 


BESl  AVAIIABIE  COPY 
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Call  SAVEPCP, paths V, TSAwE, I max, lams AVjDURSAV, 

ILRSA  Y , lambda,  DljR,  1L»  ATE,  SORT) 

GO  TO  I 

TYPE  1000,Z 

format (//,ax,F10,7,  /) 

DC  I INsl, ISAVE 

T>P£  I l.!0,  I^*,P(IN)  ,PaThSy  f IN)  .LAMBDA  (IN)  ,nuP(lN)  , ILRaTE(IN) 
,LKH0^3URT(I^)) 

POPMATdX,  13, 2X,F  10.7,  PX,  n,PX,  13, 2X,F6.1,  2X  , 1 3 , 2X  , F 1 0 , 7) 
CUNTIMIE 


13400 
1350? 
13t<00 
13?!O0 
13A00 
13<»00 
l3P0a 
13100 
13300 
13300 
13400 
13500 
13b0? 
13700 
13000 
I S')?? 
14000 
14100 
14300 
143k30 
1 4400 

14500 
14600 
I47y0 
14800 
14'?0!3 
1 S??'/! 
15100 
15300 
15300 
15400 
15530 
15600 
1 5720 
13623 
isoyn 
16  22W 
1 6 I 0 0 
1630  0 
16300 
16400 
loSZ’t 
1 6600 
1 67;i0 
1p98.):* 
I *3 '70  0 
I 7 120 
1715^ 
1 7i'j0 
1 7 5 30 

174  30 
17500 
1 7620 
I 77  ^0 
1 78T5' 
177^0 


S'JPSOUTiNc  T»P»QB(IP,UAM0DA,nuR,  IL'^ATEiP) 


c •***•««*«««***«*«««**«««****»*****«•*«**«*«**«***««««*** «**«**•* 

c 

C this  aUJPOUTlNE  COMPUTES  THE  T»AM3ITI0N  PRO9A01UITY 
C FROM  3AVFQ  PATH  IP  TO  EACH  STaTE  N aNO  STORES  THE 
C result  in  P(IP,N3, 

C 

c Variables; 

c IP-  INPUT  saved  Path  identity 

C LAHaOA-  INPUT  SAVED  LTP  STATE  IDENTITY 

C OuP-  INPUT  Saved  element  duration 

c ilpate-  Input  saved  data  rate  identity 

C P-  OUTPUT  transition  PROBABILITY  MATRIX 

c 

c the  pqllD'hing  Function  subroutines  are  used; 
c XTRaNS-  returns  The  KEYSTATE  transition  PRCPieiLITY 

c CUNOITIDNED  ON  element  TYPE  ANO  DATA  RATE 

c PTRaMS-  returns  ThE  P ATh-COND IT  ION AL  STATE  TRANSITION  PHOB 

C 

c 

c««  *«**«*«*****>«**«««**««>,•*««**«•***«««**«**»*«*««****  *«***•««*« 

dimension  p (35,30) , IELMST  (400) , ILAMI  (16) , ILAMX(61 
ni*^E'''SIOM  PIN(30) 

CQMmON  /9LKLAM/IELMST,ILAH1,ILAMX 

c 

C LOOK  UP  element  type  FOR  LTW  STATE  LAMBDA; 

C 

IF  (lambda, NE,0)  GO  TO  33 
DU  12  Nil, 30 
P (IP,N3  aoi, 

10  CONIINUE 

GO  TO  3^0 


30  IELEM.IuAMI  (IELmSKLAMBUA)) 

C 

C COMPUTE  keYSTaTE  transition  probabiliiy; 

c 

aTR-XaXTRANSCIcLEM.QUR,  ILRaTE) 

C 

C FOR  EACH  state,  compute  STATE  TRANSITION  PROBABILITY: 

C 

PaU  M*0 , 

OU  100  5 ■1,0 
';C  iJi0  I«l,5 
N«(I-n*6*H 
XEL 

IRATE*  I 

C ACU  PT7A',S  (HELM,  IRaTE,  lambda,  ILR  ate,  PTRX,PSUM,  PIN,  N) 
lO'd  CONTI  >ilJt 

P(IP,  0«mincN)/PSUM  BEST  AVAIWBIE  COPY 

. . ,.,169 


CUNTIi>iU£ 

SET.JRN 

6N0 


I** 

19 

2idP««i 
2'* 

Si 


224<iC 

235^01 

2(}<bi3U 

2*)733 

21^603 

22903 

2l!70e 

2113Q 

cl23lJ 

21302 

21403 

21503 

21600 

21732 

21802 

21903 

Sdl^ot/) 
22102 
2a2k>3 
?2?23 
22400 
22530 
22620 
22732 
22820 
22902 
23322 
2 Sl«:3 
23232 
23322 
234  12 
23523 
23632 
23702 
23832 
23902 


function  XTRANStlELEMfOa, IRATE) 


This  FUNCTIUN  tHPLEhENTS  THE  CALCULATION  OF  KE^STATE 
transition  P9uaA9ILlTY,  CONOITIONEO  ON  ELEHENT  TYPE, 
CURRENT  OUPAriOix,  AND  DATA  RATE, 

VARIABLES:  • 

lELEMf  INPUT  CURRENT  ELEMENT  TYPE 

03-  INPUT  CURRENT  element  OUMATTON 

IRATE-  INPUT  CURRENT  DATA  RATE 

TA8l£S  in  common  contain  OENSITv  farms  FOR  EACH 

element  type,  oata  rate. 


OIMENSTCn  KIMAP(b) , APARMt3) 
DaTa  KIi’IAP/1,3,1,3,7,14/ 

OATA  APaRM/3,020, 1 .520, I ,200/ 


scale  duration  and  Q5TAIN  OENSITY  PARAMETER 

MSCALEaKiMAP ( IELEM) 

RSCAL£*12P2./IRaTF. 

b0sO2/(hSCALE*RSCAL£) 

91«  tOO^S,)/ (MSCALt^RSCALE) 

rF(IELFM,E0,6)  GO  TO  22 
IF  UELEM.EQ.S)  go  TU  10 
ALPHA«MSCALtAAPARM  (1 ) 

GO  TO  132 

Al^m a»7  , •aPaRm  (2) 

GO  TO  123 

ALPnAsl<4,«APARM(5) 

) TFOI.LE.U)  go  to  222 

IFCC-^O.LT.I.J.ANO,  (Hl,GT,l,))  GO  TO  322 
YTRA>iS«Eyp(-ALPMA*f31-e2)) 

GU  TO  4/7 

? Pl»l  ,-?,'5aFxP(ALPhA*(91-1  ,)  ) 

®3*l,-2,5*ExP(ALPHA*(a0-l,)) 
XT(?ANS»Pl/Py 
GO  TO  a?,-* 


p130.5*c<PC-AlPHAa(JI-1  ,)) 
P0«l  ,-2,5*FxP  CAL'^MA*  (P2-1  ,)  ) 

xtpanssPi /og 


sClf' 


I 


I 


aaisai^ 

2<»33'9 
2442-’9 
24535^ 
2463'9 
247914 
24^33 
2''‘»!33 
25333 
25133 
25203 
25333 
25433 
25533 
25600 
25703 
25800 
25903 
26000 
26100 
26202 
26303 
26402 
26500 
26620 
26730 
26800 
26902 
27000 
27100 
27203 
2 7 300 

2/400 

27503 
2 7630 
27700 
27302 
2 7 930 
28000 
28123 
28200 
26300 
284/0 
28500 
28630 
287Z0 
28800 
2a9^j0 
29000 
29100 
29200 
293/0 
29a<,0 
29520 
296/0 
29730 
29822 
29920 


RfcKjMN 

END 


S'JPRnuTI'ME  PTRANSlKELEM,  IR6TE,LAM90A,  ILRATE,PTRX, 
2 PSiJm,PIN,N1 


THIS  PUnCTIOM  subroutine  RETURNS  THE  PATH  CONDITIONAL 
transition  prorapilities  to  each  allowable  state  N, 

VARIABLES: 

KELEB-  INPUT  CURRENT  ELEMENT  STATE 

irate-  Input  current  data  rate  state 
LaBROA-  input  identity  qp  current  ltr  state 

PTRX-  TnOuT  KEVSTaTE  TRANSITION  PROBABILITY 
ELEmTR-  EuEbEmT  transition  probability  matrix 

Function  subroutine  used: 

SPOTR-  returns  Data  rate  tansition  probs, 
conditioned  on  current  space  type. 


DIMENSION  IELMSTf400) , ILAMI ( ifel , ELEMTR ( 16, 6) 
CIBENSICM  !LAMX(6) ,PINC32) 

CONMON/BLKLAM/IELMST, ILAMI , ILAMX 
CUMmOn/BLKELB/ELEMTR 

IF  THt  SAVED  ELEBtNT  and  THE  ELEB£NT  QF  THE  STATE 
N TO  which  The  PaTH  IS  BEINC,  EXTENDED  ARE  THE 
SAME»  then  the  state  TRANS  PROB  IS  SIBPLY 
K£YSTaTe  TRaNS  PROB; 

IF  IKELEB,nE,1LAM1  CIELMSKLAMBDAin  GO  TQ  130 
P IN (N5  jPTRX 

IF  (I»aTc,NE,3)  PIn(N)«3. 

GO  TO  200 


otherv^ise; 


UBTAIN  EuEM  TRaNS  PROPS  FROM  TABLE.* 
120  PEL E b»FL£mTR( IF LBST  (LAMBDA] ,KELEm] 


NEXT  compute  ElF.m-CONDITIOnal  SPEED  TRaNS  PROB; 

PRATEiSPr'TR(IRATE,TLWATE,KELEM,ILAMi  ( IELBS  T (L  AMbD  A ] ] 1 


PTRAN5  IS  Tr,E  PRODUCT; 

FIN  (N] ■ Cl ,-»TRX) tPFLEMwPRATE 
/ PSUM«RSu^*R IH (N] 


BBl  AVWUBLE  COPY 
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I 


r-WT!^ 


I ' 

; 4 

! 

1 

i 


I 


Mil 


3ld900 
30100 
30300 
3a3i9(a 
3ia4(9« 
305^0 
3e%0a 
3^700 
30600 
30900 
31000 
3UZ0 
31200 
S13id0 
31400 
31580 
31600 
31700 
31680 
319^0 
32080 
32100 
32200 
32300 
32400 
32500 
32600 
32700 
32600 
32900 
33000 
33130 
33203 
33330 
33433 
33503 
336  13 
33700 
33800 
33903 
34003 
34100 
34200 
34303 
34403 
34530 
34603 
34700 
34800 
34930 

35333 

35103 

33230 

35300 
354/0 
35500 
336  30 
35700 
35800 
35901 


return 

ENn 


Function  spdtr cisht, ilrt, iselm, ileln) 

*«*«*«**««*«,****««************««*«***«*******  **«*«*«*« 

c 

c This  function  returns  the  data  hate  (speed)  transition 
C HHOflAdlUlTT  based  ON  THE  CURRENT  ELEN  TYPE.  THE  ALLOW- 
C able  transition  PR08S  ARE  STORED  IN  THE  TABLE  HTRANS, 

C 

C variables: 


C 

c 

ISRT- 

data 

PATH 

RATE  IDENTITY  FOR  STATE  TO  WHICH 
IS  BEING  extended 

c 

IL»T- 

data 

RATE 

ON  CURRENT  PATH 

c 

I3ELM-< 

ELEM 

TYPE 

FOR  NEXT  STATE 

c 

c 

ilelm*» 

ELFM 

TYPE 

On  CURRENT  PATH 

dimension  RTRANS (5,2) ,MEMPR(A,6) ,MEMDEL (6»6) 
common /8LKSPD/RTRANS,MEMPR 

COMhOn/BLA9aT/meMOEL 


C 

C IF  saved  element  ANO  NEvm  ELEMENT  ARE  THE 
C Same,  Then  thp^e  can  be  no  SPEED  CHAnre: 

c 

Tr (ILELM.NE.ISELM]  GO  TO  108 

spurB.i . 

IF(I3RT,Ne.3)  SPOTRS0, 

GO  TO  000 

C 

C otherwise,  OBTAIN  SPEED  TRANSITION  PRQR; 

C 

IB  3 IOEL*ME0OeLCrLeLM,  ISELM) 
iNDliMF'lPpdEELM,  ISELM) 

If  (INdI ,NE,0)  GO  TO  230 
SPOTR»0, 

Go  TO  380 

208  IjELSP*  (IS4T-3)  •lOF.L 

SPOTRsRTRANS  (ISRT,  INnn 
rSRATE*Il  hT>I06LSP 
IF(ISRATF,GT,6'3)  SPOTR»0, 

IFdSRATE.LT.  10)  SP0TR«8, 

300  RETURN 

BBI  AVAllABLE  COPY 
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i 


t 


r 

t 


ihsifie) 

361«0 

SbSifjO 

36300 

3642:? 

Sb^O?* 

36600 

36700 

36800 

36‘»0O 

37000 

37100 

37200 

37320 

37400 

37520 

37600 

37700 

37800 

3 7'i2'0 
38000 
38103 
38220 
38320 
38400 
38533 
36600 
38  702 
38000 

38922 
39'^00 
39102 
3920  3 
39320 
39400 
39502 
39602 
39730 
39800 
39900 
40200 
42100 

4 0203 
4.0323 
40402 
40500 
40600 
43730 

408  .;  3 
439.JO 
4 10. -.10 
4 I 1 j 0 
4 I 2 ,)  0 
41  3.^2 
4 1401/ 
4 15.T2 
4 160  0 
41700 
4 1802 
41900 


SUBRQUTINF.  PATH(IP,LAM80  4,nuR,  lLRATE,i.Art8AV,0URSAV,  ILRSaV) 


C 

C 

C 

C 

C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 


path  computes  The  tT«  STATE,  DURATION,  ANQ  DATA  RATE  OF 
Each  new  path  EXTENDED  TO  STATE  N, 


VARIABLES: 

IP- 

L A0BOA- 

nuR  * 

JLPaTE- 

LAHSAV- 

OURSAV- 

ILRSav- 


SAVED  PATH  IDENTITY 

uth  state  of  saved  path 

DURATION  OF  element  ON  SAVED  PATH 
DATA  RATE  OF  ELEMENT  ON  SAVED  PATH 
NEh  LTH  states  for  EACH  PATH  EXTENSION 
NE'-^  ELEM  DURATIONS  FOR  EACH  PATH  EXTENSION 

NEW  DATA  Rates  for  each  path  extension 
new  path  identity 


Tie  letter  transition  Table,  memfcn,  is  stored  in  common. 


niMENSION  LAMSA/C  752)  ,f)URSAV  ( 752),ILRSAV(  752) 
dimension  MEMFCN(420,6) , lELMST (430) , lUAMl (16) 
DIMENSION  ILAMX (6) , ISX (6) ,MEM0EL(6#6) 

COMhON/RLKLAM/IELHST, ILAMl , ILAMX 

CQHhON/SLKMEn/HEMFCN 

COMhON/slKS/ISX 

C0MM0N/8Li<RAr/M£M3gi, 

C FOR  Each  EUEM  STATF.  «,  ANO  each  speed  I,  CQMPUTei 

c 

nc  120  1*1,5 

DO  100  K*l,6 

c 

C STATE  TCENTITV  m; 

C 

N»  (i-n  *6*K 

c 

c new  path  identity: 

c 

.1*  (IP«1  ) tl30^N 

c 

C NEW  ltr  state: 

r. 

TF (LAMBDA. \E,0)  DO  TO  52 
LA'MSAV  (J)  s'* 

R 0 TO  1 3 3 

50  LAM.AAV  (J)  s.-!LMFCN  (LAMBDA,  K) 

IF  (U  AMSAV  C J)  ,Et3,3)  on  TO  100 

r 

C nf-i  o'jratiqn: 

C 

C CDT.*!'|  WEYSTATF.  of  SAvEC  PATH  AND  NEW  STATE: 

C 


BtSl  AVAllABlt  COPV 


i 

i 

] 

i 

] 

i 

i 

1 

■( 
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423(9r. 

4£l3fi 

02233 

42333 

42433 

42S33 

02633 

42723 

42S33 

02933 

03333 

03133 

03233 

03333 

03003 

03533 

03633 

03733 

03633 

03923 

O4P20 

44133 

44233 

04322 

04033 

04523 

44633 

44732 

44623 

44903 

t5333 


5230 

45330 

15033 

15533 

05633 

15730 

05833 

15933 

46333 

061^3 

06233 
06330 
06423 
16523 
06623 
06737 
06833 
06932 
0 7 023 
07122 
4 7223 
07333 
4 7400 

4 7533 

07603 
077«3 
4 7822 
07923 


iLELMalLAMl (lELMST  tUAMBOAl^ 
IXLiILAHXCILEUW] 

TxSalSX  («) 

C 

c calculate  ouration: 
c 

CUR3AV  (J)  •llUR«Cl-IXS-IXL*2*IXS<tIXL)+5. 
C 

C Nt*»  DATA  rate: 

C 

lLRSAV(J)«rLRATFXI-3)  •HEMOtL  C ILEL^i  •< ) 

122  continue 

223  RETURN 

END 


C 

C 

C 

C 

C 

C 

C 

C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 


subroutine  LIKH0CZ,RN, ip, lambda, our » 

2 iLRATt.P.LKhO) 


This  subroutine  CALCULATES,  FOP  EACH  PATH 
EXTENSION  TO  state  n,  THE  LIKELIMQOO  OF  THAT 

transition  given  the  measurement  z,  it  uses 
AN  array  of  linear  (KALHANJ  filters  To  do  so. 


VARIABLES; 

2- 

RN- 

IP- 

LaMBDA- 

OuR" 

ILRaTE- 

P- 

LisHO- 


irjPuT  measurement 
Input  noise  pui^er  estimate 
INPUT  SAVED  Path  identity 
input  Saved  ltr  state  identity 

input  SAVED  nURATIDN  OF  ELEMENT  ON  PATH  IP 

Input  Saved  data  pate  fSPEEO) 

INPUT  transition  probabilities 

Output  computed  likelihoods  for  each  trans 


SUaRDuTiNES  used: 

KaLFIL"  KaLMAM  filter  for  EACH  NEr  PATH 


peal  LKHO.LKHOJ 
CIMENSION  P(25,30) ,LKHn(750) 
dimension  IELMST (opgT , ILaMI (161 , ILAhx  C6) 
dimension  ISX(6) 

C UMHCM/aLKLAM/TELMST, ILAMl , ILAMX 
CUMhOn/ELkS/  ISX 


C 

c 


OaiAlN  -jAvEO  KEYSTATEI 


xELEMstLAMldELMSTfLAMPOA)! 
TuXxlLAMX  (t^ELE  d 


60  m\M 


iW^ii-~'  I'l  i 


48(^20 

481i^(9 

C 

482'J0 

C 

FCR  F-ACH  state: 

483'd«' 

r. 

484JZ 

CU  130 

485e0 

no  133  1*1,5 

48600 

C 

48700 

C 

obtain  KEySTATE,RA 

48800 

r 

46000 

TxSiISX  CK) 

49000 

ISRaTe«I 

49100 

N*  ( I-  1 ) •6'fK 

49230 

J=(lP-l)*33tN 

49333 

PINsf»CIP,N5 

49403 

c 

49530 

c 

CO^^PUTF  and  store 

49600 

c 

• 

49703 

CALL  KALFILCZ, 

49803 

49900 

2 OOR,  II.PATE.PIN 

50003 

LKM(j(j)*l  KML'J 

50130 

GO  TO  1^3 

50200 

IF (PIN.LF,! ,E- 

5030"f 

TYPE  1033, ip, Z 

50433 

U00  FOOMATf  IX,  12, 1 

50500 

2 ?X,F8,6,2X,F8. 

50600 

507.30 

I0t 

continue 

50800 

pt  Turn 

5tl9a,';t 

51330 

51130 

5 1 2i30 

FNO 

BtSI  AVAllABlt  COPY 


1 


•■A  j'u 


{534?:? 

»d5E3 

3063'^ 

00700 

*0800 

00003 
01000 
01100 
01200 
01300 
01400 
01500 
01633 
017«j3 
31803 
3 1 ^00 
32333 
32100 
32203 
32300 
32403 
32503 
32633 

32703 
32803 
32*533 
03300 
03l0W 
33203 
33300 
33433 
03500 
03600 
33703 
338-20 
03*5'<>0 
34300 
34103 
042^3 
0a3w0 
344/3 
34500 
34  6 00 
34  703 
34830 

7 4 4 17.  7 
05303 
35133 
3520  0 
053b3i 
35403 

35500 

35633 
35733 
3580  3 
35*560 
063?'’' 


subrout IME  KALFILCZ, THfrtN, IL* , IXS, KELEH, 
2 JWOOE, IS»ATE,0UR, ILRATE,PIN,LKHDJ) 


C**** ft «*«*••«•****«****«*• «««**«*««****«***«**«*******« 

c 

c This  subroutine  computes  the  array  of  kalman  filter 

C RECURSIONS  UStO  TO  DETERMINE  THE  LIKELIHOODS, 

C 


c 

VARIABLES; 

c 

z- 

Input 

MEASUREMENT 

c 

IP- 

INPUT 

path  identity 

c 

rn- 

INPUT 

NOISE  POWER  estimate 

c 

ILX- 

INPUT 

SAVED  KEYSTaTE  on  path  IP 

c 

IXS- 

Input 

KEYSTaT  df  new  node 

c 

KtL£N" 

input 

ELEN  state  of  new  node 

c 

israte- 

input 

SPEED  STATE  OF  NEW  NODE 

c 

OUP" 

INPU  current  duration  of  element  on  ip 

c 

ILPaTE- 

iNPyT 

SPEED  STATE  ON  PATH  IP 

c 

PIN- 

TRAmS 

PROd  FROM  Path  ip  to  node  n 

c 

c 

c 

UKHOJ- 

output 

calculated  likelihood  value 

SUUROUTI.NES 

USED 

c 

model- 

OBTAINS 

the  SIGNal-STATE-DEPENDENT  linear 

c 

model  for  The 

KALMAN  filter  recursions 

c 


real  L'<Hnj 

DIMENSION  VKKIP(255 ,PKKIP(25) 
DIMENSION  YkKSV  (750) » PKK5V  (750) 


i 

l 


COMHON/BLKSVI / YKKIP, PKK IP, YKKSV, PKKSV 


.1 

I 

OaTa  YAKlP/25ft,5/,PK'<IP/25»,13/ 

~aTa  PInmin/, 00010/  ; 


C 

C IF  transition  probability  IS  VERY  SHALL#  DON'T 
C pnT-tfeR  0ITH  LIKELIHOOD  CALCULATION: 

C 

TP (PIn.GT.PINHIM)  go  to  1L3 
t.KHi)  Jl0  , 
l.O  TO  443 


C 


f 


r 

C 

C 

C 

c 


OBTAli-!  ST ATE-oEPEMnENT  .’'D.OEL  FARamFTFpJS: 

130  CALL  M0DEL(0UR,KELF.M,  ILRaTE,  ISRaTE,  1XS,PHI,0A,HZ) 
GlT  PREVIOUS  tSTTHATES  FOR  PATH  TP 


Y^<*YK.<IP(!P) 
PxNaPKA IP (T?) 


BtST  AVAIUBLE  Im 


c 

C I.'-PlE’-'EnT  kalhaN  filter  FOR  THIS  TPANSTflON: 

c 


176. 


(96300 
06300 
06400 
06'500 
06600 
06700 
06400 
06'}00 
07000 
07100 
07300 
07300 
07400 
07S00 
07600 
07700 
27400 
07900 
08000 
08100 
06300 
08300 
08400 
08500 
08600 
08700 
08800 
08900 
09000 
09100 
09300 
09300 
09420 
2950^ 
09600 
097'0P 
09900 
09900 
10(100 
13100 
1030? 
10  300 
I 0400 
10500 
106  00 
13700 
10800 
1 2930 
I 1 000 
11133 
11320 
U330 
11400 
11530 
11630 
11703 
I 1830 
11920 
13020 


YP9E0«PHI«YKK 

PpREO»PHI*PKK<tPHl*QA 

P2«HZ<fPPREn*RN 

PZlNV«l,/PZ 

GiPPREO-HZ^PZIviV 

PEST*  (1  ,-G>*HZ3  i»PPRED 

ZRaZ-rtZi*YPR£P 


YkKSV ( JNODE) »YPReD+G*ZR 
PKKSV  C Ji'JOOE)  sPEST 

IFCYKK5VCJi400E),LE,,3n  YKKSV  (JNODE)  t.ai 

A>3,5*PZINY*ZR*>*3 
lP(A,Le,l330.)  GO  TO  300 
L!<HCJa0, 

G u r 0 4 3 0 

I 

30'/j  LKHOJa(l,/S(iRr(PZ))*EXP(-A)  i 

GO  TO  400  ■ 

type  1303,Z,H2,QA,PMr , P2,2P,G,PEST/ YKK, YKKSV ( JNOOE) , LKHOJ i 
1000  FijRMATdX,  11  CK6,3,  tX)  ,/)  i 

9 010  RtTijMN  j 

F..90  ] 


SubPOuTIME  ^10CEL(lHJR,  lELW,  ILR»  IS»,  IXS,PhT,OA,HZ) 


This  S"HRUUTT^E  COMPUTES  THE  PARAMETERS  OF  THE 
ObSEWVATIQM  STATE  TRANSITION  MATRIX  PMl,  THE 
'MEASUREMENT  MATRTy,  AND  ThE  COVARIANCES, 


c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 

c********************* 


YARlAdLES! 
L'  J 9 - 
I c:LM- 
lUR- 
ISR- 
IXS- 
PmI  A- 
SIGNAL 
OA- 
HZ- 


I'ipUT  ELEMENT  DURATION 

INPUT  element  type 

INPUT  SAVED  RATE 

INPUT  rate  op  nER  state 

INPUT  KEYSTATE  of  NEv%  state 

OUTPUT  STATE  TRANSITION  MATRIX  ENTRY  FOR 

amplitude  state 

OUTPUT  covariance  FOR  AMPLITUDE  STATE 
OUTRUT  measurement  MaTRIX  VALUE 


COMPUTE  measurement  COEFFICIENT: 


MZ«IX.S 
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BESI  AVAIUBLE  COI 

J] 


aid'd 
2209 
2300 
2409 
2509 
2600 
2790 
2900 
2900 
3000 
3100 
3200 
3300 
.3400 
3500 
3690 
3700 
3300 
3939 
4039 
4130 
4239 
4300 
4400 
4500 
.4639 
4730 
4 80  0 
4930 
5939 
.5100 
5233 
15300 
[5409 
15500 
15690 
1573-» 
I58vj0 
59ic,'' 
<>0  30 
6 1 ”• 


COMPUTE  PHI  AND  AHOLITUOE  STATE  VARIANCE  (Q)  *. 

Rl«l209,/ILR 

3AUDSaOUR/Pl 

IprriAUCS.GE, 14,)  8Aunssi4, 

IF CIFlM,GE,3)  Gn  TO  109 

QA»,009l 

PHlal , 

GO  TO  309 

5 IFCIXS.E0,9)  GO  TO  200 
PMlal , 

Ca*9,15'>EXPC9,6»(BAU0S-14,)) 

aA5aA+,ei*84uos*EXP(,2*  (I  ,-eAuos) ) 

GO  TO  309 

^ XSA^Ps22,4*R1 

PHlal3,**C-2/XSAHP) 

IF  (BAUDS, GE, 14.)  PHI«1, 

Q A s .4  , 

5 return 

EnO 


subroutine  PR03P(P,PIn, ISAVt.LKHO) 


PROBP  COMPUTES  the  POSTERIOR  PROBAblLlTT  OF  EACH 
NE''  PATH, 

VARIAaLES; 

P-  INPUT:  SAVED  PROBS  OF  PRIOR  PATHS 

Oi:TptJT  ;CnHPljTEO  posterior  ppobs  of  new  paths 
PIN-  input  transition  probabilities 
Lkho-  input  LKELTHOOOS  of  each  transition 
PSj.t-  normalizing  constant  (SUM  OF  P(J)) 

-t*l.  LKnO 

'T'ENSTCN  PC  7591 ,PIN(25,39) ,LKHO(  7501 
mSTCN  P3AV  ( 759) 


r h#tn,  each  transition: 


• 5 A < » 


» Path: 


BtsrwAiiABiE  r,nw 


iai0!8 
14220 
18330 
18430 
18530 
18600 
16700 
18630 
18900 
19000 
19130 
19300 
19300 
1 9400 

19503 

19600 

19703 

1 9600 
19900 
22000 
2010? 
232Q0 
2032? 

2040? 
23500 
23600 
30730 
20300 
23900 
2103? 
21100 
21200 
21300 
21400 
2150? 
21600 
21700 
? 1 6 3 0 
21900 
22000 
22100 
22200 
22300 
22400 
22533 
22600 
22700 
22630 
22930 
23030 

2 31?? 
23200 
233?? 
23430 
235  00 
2363? 
237'J0 
2360  ^ 
239«.? 
24000 


C 

Js  ( J*1 ) *3(S+iv 
C 

C PRODUCT  JF  PR08S,  ADD  TO  PSUM 
C 

PSAV(J) •PCI)*PIN(I»N5  *LKH0(J) 
PSUrtaPSUM  + PSAV  ( J) 

IF  CPSA'/(J)  .LE.PMAX)  r.O  TO  105) 
PMAX»PSaVCJJ 

13«  COMTINUF 


C 

c morhalize  tq  get  PRQRABiuiTiEa;  save; 


C 

NIa33*ISAVE 
DO  203 

P CJ) aPSAV (J) /PSUM 
203  CONTINUE 

retupn 

EinD 


BBS!  AVAIIABIE  COPY 


SUOHOUTINE  SPR03 (P, ISAVE, ILRSAV, PEtH,KHAT, 
2 SPDBiaT,PX1 


c 

C SPRUP  COMPUTES  THE  POSTERIOR  PR06S  OF  THE  ELEMENT 

C states, data  Rate  states, and  keystates  by  summing 
C OVER  The  aPPnOPRIATE  paths. 
c 

c variadle; 

c P-  INPUT  path  probabilities 

c TSAVE-  NUH3ER  OF  PATHS  SAVED 

c pselem-  output  element  PROB 

c spohat-  Output  speed  estimate  ioata  rate  npmj 

C PX-  OUTPUT  KEYSTATE  PRO0APTL1TY 

C 


c ***«•« I 


niMEMStON  PITS’*)  ,PSELEM(6)  , aRSAV(750) 


C 

c imttalize; 
c 

•SPOHATa^), 

PXag, 

C 

C FuP  Each  state  EXTENSITN  OF  PATH  m; 

C UblATfi  element  state  PRQBS, KEYSTATE  PROPS, SPEED  EST; 
C 

Du  103  Ksi.b 
PoEI.Emia)  a'». 


aa\0C3 

aaaac* 

243^0 
3440? 
2450!? 
2462rt 
24720 
24800 
24900 
25030 
25100 
25200 
25520 
25403 
25500 
25800 
25732 
25800 
25923 
2S020 
28123 
26220 
28320 
26420 
26530 
26820 
28723 
28830 
26920 
2 7003 
27130 
27220 
27330 
27432 
27530 
27830 
27730 
27933 
27920 
23000 
28120 
28233 
28333 
28423 
28500 
28820 
28  732 
28832 
28923 
29003 
29103 
29232 
29333 
29423 
29522 
29823 
29720 
29«20 
29922 
30020 


00  100  1*1.5 

N* ( T«l 1 *8*K 

[)C  103  3al,ISAVE 

J«  (i3«l)  *33* N 

PSElEMCKI aPSELEM(K)*P(J) 
SPOHATaSPnHATtiLPSAV ( J) aP (J) 
IFCK.GT.2}  GO  TO  100 

PXaPXtP  ( J) 

CONTTNUE 

P£LMa3, 

00  233  K81,8 

IP  (PSEUEMCK) ,LT,PELM)  go  TO  232 

PELf-’aPSELE^'CK) 

K.iATaK 

CONTINUE  nr 


PETuPN 

END 


BEST  'AVAIUBLE  COBY 


SoBROuTIN'E  SAVEP(P,PATHSV,ISAV£,lMAX,LArtSAV, 
OURSAV,  ILf<SAV,UAMBOA,OUP,  ILP  ATE,  SORT) 


This  SUBROUTINE  performs  the  algorithm  to  SAVE 

The  Paths  with  highest  posterior  PR0BA9ILITy, 
ir  will  Save  a hInIIMUM  of  7 PATHS  (ONE  for  each 
element  STaTF  and  ONfE  AOniTJONAu  NOUEJ  , AND 
A maximum  OF  25  Paths,  within  these  limits,  it 
Saves  onli  enough  to  make  the  total  saved  PROBAaiLiTY 

EGUAL  T(1  POPT, 

AjOITin>j4j_LY^  jj  RESORTS  THE  L AMPD  A , OUP  , AnO  ILRATE 
arrays  to  correspond  to  The  saved  nodes. 


Variables: 

?- 

PATmSV- 

iSAve- 

1 1'1  A X - 
L aMSa  V. 
DURSAV- 
IlRSav- 
LA-^BOa* 

OllR- 
IlR aY^. 


input  PROUAUILITY  array  of  new  nodes 
curpur  array  of  the  previous  nodes  to 
which  The  Saved  nodes  are  connected, 

TNOIJT:  NO,  OF  PREVIOUS  MODES  SAVED 

output:  no,  of  nooes  saved  at  current  stage 

INDEX  OF  highest  probability  NODE 

Input  array  cf  i.tr  states  at  each  new  node 

TNPijT  array  cf  saved  durations 

iHPgT  array  of  SAVEi.'*  RATES 

Output  array  of  saved  ltr  states,  sorted 

ACCGROlNr,  Tfj  PRuPAPILITY 

Output  array  of  sorted  durations 
Output  array  of  sorted  rates 


iNTEGdR  PaThSV^SORT 

OI'^ENSrCN  PC  752)  ,PaThSV(25)  ,PSAVC25)  ,S0RTC25) 
DIMEUSIO.'  LAmSAVC  750),OURSAV(  752),lLRSAVt  750) 


30100 
30300 
30300 
30400 
30500 
30600 
307  00 
30600 
30900 
31000 
31100 
31300 
31300 
31400 
31500 
31600 
31700 
31600 
31900 
33000 
33100 
33300 
33300 
33400 
33500 
33600 
33700 
33800 
33900 
33000 
33100 
33300 
33300 
334C0 
33500 
33600 
33700 
33600 
33900 
34  00^ 
34100 
34300 
34300 

344:00 
34500 
34600 
34703 
34600 
349-)0 
35000 
351  00 
35300 
35300 
35400 
355^0 
35630 
357  3 3 
358.30 
35900 
3600? 


OI^ENSIOM  LAM0OA(35J ,0URf35) , ILRATECaS) 
OIMEMSION  YKKIPC35) /PKKIPC35) 
dimension  VK<SV(750) ,PKKSV(75a3 
PIMENSIQN  IC0nV(3S) 

COMMQN/aLKSVl/YKKIPiPKKIP, yXKSV,PKK3V 

data  POPT/,90/ 

r4SAV»a 

P5Uf-1*l3, 

C 

c setter  SIX  highest  pros  element  state  nodes; 
c 

00  2013  x*l,6 
PMAX*(!‘, 

DO  100  IP>1,1SAVE 
00  100  1*1,5 
J»(IP-n*30+fI-l3*6  + K 
IF(P(J) .LT.PMaX)  go  to  100 
PMAX«P(J) 

JSA V* J 
IPSaVsIP 
190  Continue 

IFfPMAX,Ge,9.B03001)  60  To  ISO 
go  to  300 


150  NSAVsnSaV+I 

PSUMsPSUH+PMAX 
P34V (NSAV) sPMAX 
Pa  ThSv  C.nSaV)  •IPSAV 
SORT  fNSAVl aJSAV 
390  CONTINUE 


C 

C SELECT  tNOUGH  ADDITIONAL  NODES  TO  MAKE  TOTAL 
C PHOtiABiLl  TY  SAVED  EQUAL  TQ  PCPT,  OR  A MAX 
C OF  35; 

C 

529  PfiAx*w, 

DO  500  IP*1,I5AVE 

DO  509  N*l,30 

J8(IP-1) *30+N 

on  519  IsI.NSaV 

Tr ( J.EQ.SGRT  (11 ) GO  TO  590 

519  continue 

IF  (P  ( J1  .LE.PMAX)  GO  TO  599 
PriAXap  (J) 

J S A V a J 
IPSAValP 
509  COnTTn'jE 

PSUNspSUM+0NAX 
NbAvaJSAVfl 
P3AV  (')SA  V)  apMAX 
PAThSv  (nSaV) «IPSAV 
SC»T  (nSaV) aJSAV 


TIT?* 


jr 


i 


3610C3 

36299 

36399 

364.^0 

3q599 

36609 

36709 

36609 

36990 

37999 

37199 

37299 

37390 

37409 

37690 

37700 

38199 

36299 

38309 

38400 

38599 

33600 

38700 

38809 

38999 

39090 

39130 

39209 

39390 

39400 

39500 

39690 

39700 

39800 

39909 

40099 

40130 

40200 

40300 

40400 

49539 
40609 
40709 
40800 
40900 
41909 
41109 
41209 
41309 
4 1/J09 
41500 
41600 
4 1700 
41839 

4190/ 

4299-1 

42109 

422/9 

42300 

42490 


IF(PSUM,GE,POPT)  GO  TO  600 
IF (NSAV,Ge,25  ) 60  TO  600 
GO  TO  520 

C 

C NEW  ISAVF.  EQUALS  NO,  OF  NODES  SAVEOI 
C 

633  ISAVEiNSAV 
C 

C SORT  THE  SAVED  APRAYS  TO  OBTAIN  THE  ARRAYS 
0 TO  BE  USED  FOR  THE  NEXT  ITERATION: 

C ALSO  OBTAIN  highest  PROBABILITY  NODE: 

C 

CO  700  l«l,ISAVe 
PCn»PSAV(I)/PSuH 
LAMuDACn«LAMSAV(SOPT(I)  J 
9URCl)aOURSAV(SCRT(I)) 

ILRaTeCI)«ILRSAV (SORT  (I) ) 

YKKIP(T)  ayKKSV  (SORT  (in 
PKKiPd)  spKKSV  (SORT  (in 
703  continue 


79a 


6 19 

0 aa 


R'/V/ 


OU  790  IsinSAVE 
ICONVd)  al 
CONTINUE 


ISAVHlalSAVE-l 
CO  800  Nai.ISAVHl 
IFdCONVfNJ.Ffl.a)  GO  TO  800 

NPLuSl aN+i 

DO  810  KaNPLUSl , ISAVE 
IF  dCONV  (Kl  ,EQ,3)  GO  TO  819 

IF(ILRATE(K).NE,IuRATE(Nn  GO  TO  810 
IKOURfK)  .Nfc.CURCN)  ) GO  TO  810 
IF (LAM30A (n , ME, LAMBDA  (N))  GD  TO  810 
ICONV (K ) a0 

CONTINUE 

continue 


P 5 U n a 0 , 

Na  1 

on  900  I 3 2, is A vt 

IF  (ICONV  d)  .eg. e)  GO  TO  990 


MaN+l 

lambda  (NI  aLAHBDA  d) 
f)UR(N)aUlJR(I) 

ILRATE(N)aIuRATECn 

YrK  lP(N}aVXKIPd) 
PKXIP(M)  8PK^IPdJ 
PAThSV (Nl sPATMBV  1 1 ) 
SORKNlaSOPIdl 
P(N)aP(n 

PSUM«PSUf>P  (M) 
CONTINUE 

ISA  /EaN 


BtST.AVAllABLE  COPY 
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ae5i9(^ 

425se 

pmax^o. 

426id0 

00  950  I»l,ISAVc 

427(919 

P(n«Pa)/PSUM 

42710 

irtP(I) ,U£,PMAX)  go  to  950 

42720 

PMAX»P  (I) 

42730 

IMAXal 

428.90 

950 

CONTINUE 

42900 

43000 

peturn 

43100 

End 

43200 

AVMlABlt  COPV 
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! 

i 


? ; 
' I 


r 

!| 

r 

t 

f 


P0100 

0(ii<d9 

mim 

Ti^az'd 

otasea 
ec3b0>7i 
00723 
00800 
00000 
01000 
01100 
01200 
01300 
01420 
01SQ0 
01600 
01700 
01800 
01900 
02000 
02100 
02200 
02300 
02400 
02500 
02600 
02700 
02800 
02400 
03000 
03100 
03200 
03300 
03400 
03500 
03600 
0370  0 
03803 
03400 
04000 
04100 
04200 
04300 
04400 
0450  0 
04600 
0470P 
04800 
04400 
05000 
0510? 
05200 
05300 
05401 
05503 
05600 
05  700 
05820 
?54ti0 
06003 


3UBK0UTIN6  TRELI8(ISAVe,PATH8V,LAMB0A,IMAX) 

C*« **«**««**«******«******«*•**«««****««**«*«**««***«« 

c 

c This  suoroutike  stores  the  saved  nodes  at  each 
c stage  AMO  forms  the  tree  of  saved  paths  linking 
C The  nodes,  decoding  is  accomplished  by  finding 
c The  convergent  path  if  it  occurs  within  a maximum 

C DELAY  SET  BY  TH£  PARAMETER  NOELAV,  IF  CONVERGENCE 
C TO  A single  path  does  NQT  OCCUR,  THEN  DECODING  IS 
C DONE  3Y  reading  THE  LETTER  ON  THE  PaTH  WITH  HIGHEST 
C PROBABILITY, 

C 


INTEGER  PTHTRL.PATHSV 

DlMtNSION  paths V f251 , lambda (251 ,PrHTRL (200, 25) 
dimension  lmOSAV (200,25) ,IPN00 (25) ,LTRSV (200) 

cdhhon/blkend/ieno 


data  PThTRL/5000*5/,LMDS4V/5300«5/ 

OaTa  n/;^/ , iNDELA  Y/200/ 

data  IPN0P/25«1 / ,NCALL/a/,NMAX/0/, MHAX/0/ 


C 

C KEEP  average  of  ISAV6,N0EL  FOR  DATA  ANALYSIS.* 

C 

nCaLLaNCALL-*-) 
iFCifcNn,Ne,i)  GO  TO  10 
ISAVG«XS^VG 

NJLAVGaXOLAVG  ; 

ItNO*0 

type  2000, T3AVG,N0LaVG 

2000  FDRMATdX, 'AVG  NO  OF  PATHS  SAVED!  %T2,2X, 

2 *AVG  DECnoE  delay:  ',13) 

TVPE  3000, XHMAX , XnMAX 

3000  FORMAT (IX, 'PERCENT  OF  TIME  PATHS«25:  ',F3,2, 

2 2X, 'PERCENT  OF  TIME  OELAY3200:  ',F5,2) 

ACCEPT  2300, HAIT 

Ife)  XSAVGa (aSAVGa(NC4LL-1)*ISAV£)/MCALL  I 

XGLAVG« (XDLAVG* (NCALL-1 ) ♦NOEL) /NC ALL 
IE  (NDEL,Nt.,NOELAY)  GO  TO  21 
NMA X sNMAX^ 1 
Xi'«MAX«NMAX 
XA'HaXsXNMAX/NCALL 
20  IF (ISAVt,NE,25)  GO  TO  30 

«^AX*HMMXt^ 

X^MAXaMMAX  I 

XnMAXaXMMAX/NCALl.  } 

30  CONTINUE 


C 

C 

c 

c 


SYOKt  PaTHSV  and  CORRESPONDING  LAMBDA  IN  THE 
TRtLi-15  USING  A CIRCULAR  BUFFER  OF  LENGTH  NOELAY! 


NrN*  I 

IF  (f  ,EQ,Mi;ELAY  + l ) N»1 
"*0  lal,I?AVt 

PT'^TRl(n,  DaPATHSVd) 
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Z6\io9 

ZbZZZ 

06300 

06400 

06500 

06600 

06700 

06800 

06900 

07000 

07100 

07200 

07300 

07400 

07500 

07600 

07700 

07900 

07900 

06000 

03100 

08200 

03300 

03400 

08530 

08600 

08700 

08300 

08900 

09000 

09100 

09200 

09330 

09430 

09530 

09600 

09730 

09900 

09  900 
13000 
101wO 
12200 
13303 
134'/|0 
1050  0 
10600 

10  700 
1 0300 
10900 
U0B0 
11100 
11230 
11320 
1 1400 
11500 
1 1600 
11730 
1 1 A J'0 
1 I9v  0 
12000 


LN'OSAV  (N,  II  3tAMB3A  (I) 
100  CONTINUE 


C 

C PEXKORM  dynamic  PROGRAM  ROUTINE  TQ  FINO 
C CONVERGENT  PATH: 

C 

><30 

00  100  l3l,ISAVE 
IPNQO(I) 3l 

180  continue 

190  KiK+1 

IF  (K.EQ.MOELAYJ  GO  TO  700 
00  200  IP31,ISAVE 
IsN-K+l 

IF(I,LE,B)  I3N0EI.AY  + I 
IPN00(IP)3PTHTRL(I, IPnOO(IP)1 
IF (IP.EQ.IMflX)  IPMAX3IPN0D(IP) 

200  CONTINUE 

C IF  mLL  nodes  are  EQUAL,  THEN  PATHS  CONVERGE: 

C 

DC  300  IEQs2,ISAVE 

IFClPNOOCn.NE.lPNOOdEQ))  GO  TO  190 
300  CONTINUE 

C 

c Paths  converge;  set  nqel: 
c 

ndEl»k>i 

c 

c IF  POINT  OF  CONVERGENCE  IS  SAME  AS  IT  WAS  QN 

C Last  CALL,  then  no  need  TO  RE-DECOPF.  SAME  NOPE: 

C 

IFCNPEL.EJ.nOELST+I)  go  TO  800 
C 

C IF  POINT  OF  CONVERGENCE  OCCURS  AT  SAME  DELAY  AS 
C LAST  call,  then  TRANSLATE: 

C 

IF{^JDeL,NE.NOELST)  GO  TO  353 
I3N-NDEL+1 

U(I,LE,0)  l3r.'DELAY4l 
LTRsLM03AV(I,IPN00(1)) 

CALL  TRAN8L(LTR3 
GO  TO  8»3G 

C OrHER-ISF,  POINT  OF  CONVERGENCE  HAS  QCCURED 
C EaRLIEP  on  this  Call,  so  need  to  translate 

C cVERYThINR  on  the  rONVFPGENT  PATH  FROM 
C MRENTOUS  POINT  OF  CONVERGENCE  TO  THIS  POINT; 

C 

35  J 

TF3lP,vOi)Cl) 

CU  400  Ath'TEL.NOELST 

i)3K  1 
I3N-I<»1 


BESLAVAllABLE_CQEy 


j 
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laiDo 

12800 

12300 

12^00 

12500 

>100 

12600 

C 

12700 

c 

12800 

c 

12900 

c 

13000 

13100 

13200 

13300 

c 

13900 

13500 

13600 

500 

13700 

13800 

700 

13900 

C 

1 4000 

C 

14100 

C 

14200 

C 

14300 

14400 

14500 

14600 

14700 

14800 

14900 

C 

15900 

C 

15100 

c 

15200 

C 

15300 

15400 

1350? 

15600 

C 

15700 

15800 

1590? 

75>J 

16000 

16100 

1 fa?O0 

1 oSUO 
16400 
16500 
16600 
16700 
16800 

16  90'" 

800 

17  090 

C * • * 

17U0 

C 

1 7200 

c 

17  301 

r 

1 7407. 

c 

17590 

c 

17690 

17  70? 

1 7800 
17900 

1 8000 

C « « a 

IFd.L.e.f’)  I«NnELAY  + I 
LTRSV  CKO) sLMDSAV  fl, IP) 
IP»PThTRL(I,IP) 

continue 


reverse  order  of  decoded  letters,  since  they 

><ERE  D3TAINE0  PROH  THE  TRELLIS  IN  REVERSE; 

translate  each; 

DO  50J  1*1, KO 
LTRaLTRSV(KD-I  + n 
CALL  TRANSLiLTR) 

continue 

GO  TO  8dD 


m CONTINUE 


PuThS  have  not  converged  AT  MAXIMUM  ALLOWABLE 
OELaT,  SO  TRANSLATE  WHAT  IS  ON  HIGHEST 

prohability  Path; 

NDEL^nOELaY 
IsN-NOELAY+I 
IP(I.LE.?1)  laNDELAY  + I 
LTR«UHOSav(I,IPMAX) 

CALL  TRANSL(LTR) 


prune  AwAY  nodes  i-HlCH  are  NOT  ON 
This  path; 

DO  75b  <*i,lSAVE 

. IF (IPnOO (K) .EQ. IPHAX)  GO  TO  75B 
LAM!3DA(K)aO 
CONTINUE 


►'DELSIaNHEL 

WtTuWN 

END 


BEST  AVAIUBIE  COPY 


StQROuTIve  TRaNSLCLTR) 


This  SU0ROUTINE  PRODUCES  THE  OUTPUT  TEXT  ON  A CRT, 

n OSES  The  simple  formatting  rules  descrised  in  the 
text. 


T^T£^.fcR  SPELaG.ELMHaIiELMOUT 

OIME'^SIUN  l.TPMAPfaPP))  , IALPH(7ai  , IBLaNK  («P0) 

DI'ENSTUN  TELMST(40n),lLAHl(lfa),TLAMX(e>) 


0 

16203 
18300 
16400 
16500 
18600 
16700 
18600 
18900 
19000 
19100 
19200 
19300 
19400 
19500 
19800 
19700 
19600 
19900 
20000 
20100 
20200 
20300 
204^0 
20500 
20800 
20700 
20600 
2 0 9 it!  0 
21000 
21100 
21200 
21300 
21400 
21500 
21800 
21700 
21800 
21900 
220'30 
22 1 
22200' 
223001 
22400 
225160 
22800 
22700 
22830 
22930 
23000 
23100 
23230 
233?0 
2340'^ 
235/3 
23630 
23700 
23flr30 
23930 
24  0 0 0 


5030 


COHMON/BLKTRN/LTRMAP, I4LPH, IBLANK 
CCMHON/BLKLAM/IELMST, ILAMI , ILAMX 

OaTa  ISPAUE/'  '/,SPFLAG/0/,NCHAR/0/ 


PETERMINE  if  a csp,wsp»or  pause  to  mark  transition 
Has  occureo;  if  so  ltr  is  ready  for  output: 

ELMHAT«IUaMI  (IELMSTCLTR)) 
iXLalLAMXCELMHAT) 

IFCIXL,£Q.IXLaST)  go  to  700 
IF(CIXL.EQ,n,AM0,(LSTEUM,GE,4))  GO  TO  10 
IFCCIXL.EQ,0).ANO,(LSTELM,LE.2))  go  to  700 
GO  TO  700 


LTRHATauSTLTR 

Lr90UT«IALPH(LTRMAP(LTRHAT) ) 
NOLaNKsIPLANK (LTRHAT) 
FUMOUTallAMl (IELMST(LTRhAT) ) 
GU  TO  40 

type  5030,ELPOUT 
PQRMATdX,  U.S) 
nchaR«ncHaR+1 


I 5/j0 


13  30 


1 1 .J0 


continue 

IF  (lTRMaP  (LTRHATI ,EG,43)  GO  TO  50 
IF CLTRMaP  (LTRHAT) ,LE, 44)  GO  TO  100 
IF(lTRMAP(LTRHAT) ,LE.46)  GO  TO  200 
IF  (UTRMaP (LTRHAT) ,LE. 60)  GO  TO  300 
IF  (lTSMaP  (LTRHAT)  ,EG,6n  GO  TO  400 
IF  (LTRMAP(LTRhAT) ,E0,66)  GO  TQ  500 
GO  TO  550 

IF(SPFLAG.6G,0)  GO  TO  100 
NCHARs? 

type  1500,LTROUT 
FGRhaT(2X,41,/) 

SPFLAGaI 
GO  TO  80/ 

NCHARaNCh AR+ 1 
Type  l0/0,LrRJiJT 
P0RmaT(IX,A1,S) 

SPFlAGsO 

IF  (nPLAink  ,£0,0)  GO  TO  110 

SPFLAGt I 

00  110  I*  I,. '-BLANK 
?)CHaRsNC^*AR*1 
Type  i0?0,isPACc 
CuN  T I NUt 

ARsNC'^a9<-2 

Type  ldA*,LTRO'JT 

format  f IX , A2, a) 

SPFiAGsM 


BtSlAVAlUBLE  COPY 


' 1 

r 


: I 


3418^ 

IF  (N8LA.MK.tO,0]  GO 

TO 

210 

SPFlAG*! 

24303 

DC  210  I«1#n8UANK 

24403 

NiC^ARaNCHAR+l 

24500 

type  1003,I3PACE 

24600 

210 

continue 

24700 

24503 

GO  TO  600 

24930 

300 

NCHARaNCHAR+4 

25003 

type  1200,I.TROUT 

25100 

1200 

F0RmaT(2X, A2,2X,SJ 

25200 

SPFLAOal 

25330 

IF  (NBUANK.EQ.a)  GO 

TO 

310 

25400 

CC  313  I«1,N8LANK 

25500 

NChARaNCNAR+l 

25600 

Type  10O0,ISPACE 

25703 

310 

CONTIi'^lJE 

25800 

GO  TO  600  . 

25300 

26000 

400 

NCHARaNCHARtS 

26100 

type  1300,I.TROUT 

26200 

1300 

FuRr-iATC2X,A3i2Y|S) 

26300 

SP^LAGal 

26400 

26500 

GO  TO  600 

26600 

500 

NCH ARa0 

26700 

Type  143P',ITR0UT 

26800 

1 4v3  0 

FOR^tATf/,  10X,A2,/, 

10  X) 

26903 

SPFLAGai 

27300 

GO  TO  630 

27100 

27200 

550 

NCNARaNCHAR+S 

• 

27300 

type  1 rv!)0,LTRCUT 

27403 

17.33 

Fi)RM4T(2X,  A3,PX,.$J 

27500 

SPFLAGaa 

2 7600 

IF  (N0LANX ,EJ.0)  GO 

TO 

560 

27700 

SPFLAGal 

27803 

00  560  Ial,NRLANK 

27900 

NCHARaNCHAR+l 

28000 

TrPE  l3t30,ISPACE 

28130 

563 

continue 

23200 

28300 

28400 

600 

IF  (MCHAR,j.T,52)  GO 

TO 

7 00 

28500 

’’VRE  1600 

28600 

160  3 

F0»MAT(/, 13X7 

28700 

28830 

NCHAR30 

28903 

7 33 

TXLASTalXL 

29000 

UST£L'“'*ELNHAT 

29103 

29200 

LSTuTf^aLTR 

29333 

PbT  (jRN 

29400 

29533 

ENO 

i 
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I 


90100 
00209 
00300 
00400 
00500 
00600 
0U700 
00800 
00900 
01000 
01100 
01200 
0 1 300 
01400 
01500 
01600 
01700 
01300 
01900 
02000 ■ 
02100 
02200 
02300 
02400 
02500 
02600 
02700 
02900 
02900 
03000 
03100 
03200 
03300 
03400 
03500 
33600 
03700 
03800 
03900 
0400  0 
04100 
04200 
04300 
04400 
0 4530 
04600 
04700 
•34800 
04  90 '9 
05000 
35100 
35200 
35330 
05400 
35500 
35600 
057a’' 
05800 
05900 
06030 


c> 

c 

c 

c 

c 

c. 


SuSROUTINfc  RCyRCZIN,ZUUT) 


This  subhcutine  converts  tme  input  signal  at 
Radian  fREQ  wc  to  1030  HZ, 


CCMrtON/aUKl/TAU/aL»<2/wC  j 

data  THtTA/B,/,THETLO/0,/ 

THETA*THETA-f(MC*TAu  ] 

rM6TAiAH00tTHETA,6,28il91  I 

7.I*ZIN*C0S(THeTA)  I 

ZQsZINaSInCTHETA) 

ZlUP«ZlLP'*-,37e#CZI-ZILP)  i 

ZQLPaZOLP^.eTOtrCZQ-zotP) 

THErL0«THtTL0+6283,2*TAy 
the TLOsaMOD CTHETLO, 6,28319) 

ZJUT*  ZILP-COSCTHETLOI+ZQLPoSINCThETLO) 

i 

RETURN 

EnO 


SuRKOUTiNt  BPFOETCZINjZ) 


C 

C 

c 

c 

c 

c 

c 


This  SUSPOUTIME  IMPLEbENTS  THE  BANDPASS  FILTER  AND 
envelope  DETECTUR  FijnCTIDNS,  ThE  0PF  IS  A SIMPLE  CASCADE 
OE  T^g  2-HDLf  digital  RESONATORS  AT  A CENTER  FREQ  OF 
13 -^3  rtZ.  THE  lPF  of  ThE  ENVELOPE  UETECTOR  IS  A 
ThReE-PQLE  CHEBYSCHEV  100  HZ  LPF, 


DIMENSION  A (4) 

OaTa  a/,0h0033051 ,2,95a7983,2,93396345,-,953135l7a/ 
0*1“ A CK  1/1 ,37l58/,CK2/,9409/,CG/,0l5«/ 

Data  Cl/1, 27 26 /,C2/,«100/,C/, 1933/ 

C 

r IFF  IS  Tvo  a-POuE  RESONATORS: 

c 

^I3sw? 
i».0  a 1 
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962213 
96399 
96409 
96599 
96699 
96709 
96899 
96*900 
07  009 
97109 
97299 
97399 
97499 
07590 
97600 
0779(7 
97809 
9 7909 
98009 
08100 
08209 
98309 
98490 
08599 
08690 
98790 
08800 
989^9 
99000 
99100 
09200 
09399 
09409 
09509 
99609 
99700 
09809 
99900 
10909 
10109 
1Z209 
10309 
19499 
19599 
10609 
10709 
10839 
10909 
11900 
1 1100 
11200 
1 1390 
1 1 a/9 
11509 
11600 
11709 
11890 
11999 
12909 


■'<1»C1*W2»C2*03+C*ZIN 

X3SX2 

X2»Xl 

Xl«CKl*xa-CK2*X3*CG»i<ll 

ZrtPFaXl 


EmvELOPE  detector  (SQUARE-LAW): 
SQUARE- 

XUET»SQRT(Z0PF**2) 


L0'.'(-PAS3  rilter- 


T3»Y2 

VPsYl 

Y1*Y0 

V0sXOtTi»A  (1  J 

Z3*Z2 

Z2«Zl 

ZlaZ 

Zs'^0  + 3,<t(Yl  + Y2)+Y3 

ZaZ  + A (2)  <iZl-A  (3)  tirZ2-A  (4)*Z3 


KETuRN 

End 


subroutine  noise CZIN,RM, Z) 


ThTS  SUaROUTTNE  ESTIMATES  ThF  iyOTSE  POWfiP  IN  THE 
envelope  detected  output  for  USE  9Y  THE  KALMAN 
filters,  an  estimate  of  the  noise  power  is 
ALSO  SuarRACTED  FRO*^  t«e  envelope  detected  signal 
IN  QWCER  TO  produce  A ZERO-MEAN  NOTSE  PROCESS 
AT  Trie  INPUT  T(0  ThE  MQ»SE  PROCESSOR, 


DIMENSION  YlONG  (2U0) , YSnORT (53) 

fUtA  YLijNG/20O*l  ,/,  YSHORT/5m*1  ,/ 
Data  kl/1/.kkl/1/,kS/1/,<KS/1/ 

HaTa  YMINl/l,/,YMtN2/l,/,YMAVG/,95/ 


a N L 1 1 

IF  fKL.E  ).29n  KL»1 
KSaKS*l 

TE  (XS.EQ.snKSai 
K K L « K ^ L * 1. 

IF  (KKL,GE,209)  KKi,«2a9 


BEST  AVAIIABIE  (BPY 


is 


12730  YHlwl«2lN 

12830  YMTn2«ZI‘^ 

12900 

13000  13  ,30  \Zia  isliKKt 

13130  IF CYLONGCn ,GT, ymini)  GO  TO  100 

13200  YcilNl*rLONG(r) 

13300  100  CONTINUe 

13900 

13500  OC  203  Ial,KKS 

IF  (ySHOHT  CU  .GT,YMIN23  GO  TO  230 
13730  Yi«!lN2aYSH0ST  Cn 

13800  200  CCSTI.NUt 

13900 

14000  YMlNsYMlNl 

14100  IF  (YMl^J2,LT,YMI^l)  YMINSYHIN2 

14230 

14300  Y,-14\/G8Yf-,AVG+,a04*(YHlN-YMAVG) 

14400 

145»30  f?r’ts3,3w*y,-iAvG 

14600  IF  f«N,u7,a,0051  «,‘Y«3,305 

14700  Zal , I * (ZIN-2,4*YMAVG-,051 

I 4830 

149U0  i?£ru«.-'J 

15030  E.ND 
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